Skip to content

Instantly share code, notes, and snippets.

@maedoc

maedoc/femto-deltanet-jax.ipynb

Last active April 1, 2025 20:31
Show Gist options
  • Save maedoc/7bbe83240d35aa34419dab6071bd98b0 to your computer and use it in GitHub Desktop.
Save maedoc/7bbe83240d35aa34419dab6071bd98b0 to your computer and use it in GitHub Desktop.
Download ZIP
an attention only deltanet-style model, inspired by the nanoGPT repository, in jax
Display the source blob
Display the rendered blob
Raw
femto-deltanet-jax.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment