beyonddream

Install direnv

1. brew install direnv
2. echo 'eval "$(direnv hook bash)"' >> ~/.bashrc # and restart terminal
3. direnv version

Installation of Python virtual environment

1. python3 -m venv .venv # python or python3 should already be installed
2. echo 'source .venv/bin/activate' > .envrc

beyonddream

tmux cheat sheet

(C-x means ctrl+x, M-x means alt+x)

Prefix key

The default prefix is C-b. If you (or your muscle memory) prefer C-a, you need to add this to ~/.tmux.conf:

remap prefix to Control + a

beyonddream

"""
The most atomic way to train and inference a GPT in pure, dependency-free Python.
This file is the complete algorithm.
Everything else is just efficiency.

@karpathy
"""

import os       # os.path.exists
import math     # math.log, math.exp