Repository: nano-llama31 Description: nanoGPT style version of Llama 3.1 Language: Python Stars: 1,431 Created: 2024-08-01
Repository: minbpe Description: Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Language: Python Stars: 10,006 Created: 2024-02-16
Repository: minGPT Description: A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training Language: Python Stars: 22,722 Created: 2020-08-17
Repository: micrograd Description: A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API Language: Jupyter Notebook Stars: 12,916 Created: 2020-04-13
Repository: makemore Description: An autoregressive character-level language model for making more things Language: Python Stars: 3,335 Created: 2022-06-09
Repository: llm.c Description: LLM training in simple, raw C/CUDA Language: Cuda Stars: 27,836 Created: 2024-04-08
Repository: llama2.c Description: Inference Llama 2 in one file of pure C Language: C Stars: 18,844 Created: 2023-07-23
Repository: lifejs Description: Artificial Life simulator using canvas. Based on https://github.com/karpathy/scriptsbots Language: JavaScript Stars: 84 Created: 2012-05-29
Repository: lecun1989-repro Description: Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation. Language: Jupyter Notebook Stars: 663 Created: 2022-03-10
Repository: karpathy Description: root repo Language: Unknown Stars: 42 Created: 2021-04-27