Skip to content

Instantly share code, notes, and snippets.

View TalKachman's full-sized avatar
🎯
Focusing

Tal Kachman TalKachman

🎯
Focusing
View GitHub Profile

Learning LLMs in 2025

So you know how the transformer works, and you know basic ML/DL, and you want to learn more about LLMs. One way to go is looking into the various "algorithmic" stuff (optimization algorithms, RL, DPO, etc). Lot's of materials on that. But the interesting stuff is (in my opinion at least) not there.

This is an attempt to collect a list of academic (or academic-like) materials that explore LLMs from other directions, and focus on the non-ML-algorithmic aspects.

Courses

  • David Chiang's Theory of Neural Networks course.
  • This is not primarily LLMs, but does have substantial section on Transformers. Formal/Theory. More of a book than a course.
@TalKachman
TalKachman / hdf_to_parquet.py
Created September 24, 2022 16:05 — forked from jiffyclub/hdf_to_parquet.py
Do the same thing in Spark and Pandas
"""
Convert Pandas DFs in an HDFStore to parquet files for better compatibility
with Spark.
Run from the command line with:
spark-submit --driver-memory 4g --master 'local[*]' hdf5_to_parquet.py
"""
import pandas as pd
@TalKachman
TalKachman / minimal_lightning_example.ipynb
Last active July 20, 2022 18:47
minimal pl lightning
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.