Skip to content

Instantly share code, notes, and snippets.

@alexweberk

alexweberk/mlx_finetuning_gemma.ipynb

Last active October 28, 2024 01:46
Show Gist options
  • Save alexweberk/635431b5c5773efd6d1755801020429f to your computer and use it in GitHub Desktop.
Save alexweberk/635431b5c5773efd6d1755801020429f to your computer and use it in GitHub Desktop.
Download ZIP
MLX Fine-tuning Google Gemma
Display the source blob
Display the rendered blob
Raw
mlx_finetuning_gemma.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@johngroves
Copy link

johngroves commented Mar 6, 2024 •
edited
Loading

This was super helpful!

One change might be needed:

!python -m mlx_lm.generate --model "google/gemma-7b-it"
--adapter-file checkpoints/600_adapters.npz
--max-tokens 256
--prompt "Why is the sky blue?"
--seed 69

@alexweberk
Copy link
Author

@johngroves glad to hear!
You're right, thanks for pointing that out. Just updated that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment