Skip to content

Instantly share code, notes, and snippets.

@AnteaterKit

AnteaterKit/gist:e24a20df3fbe713e44bd905f809e91a9

Created June 29, 2025 14:59
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save AnteaterKit/e24a20df3fbe713e44bd905f809e91a9 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save AnteaterKit/e24a20df3fbe713e44bd905f809e91a9 to your computer and use it in GitHub Desktop.
Download ZIP
convert model to gguf
Raw
gistfile1.txt
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
cmake -B build
cmake --build build --config Release
python3 convert_hf_to_gguf.py ../../jupyter/modelpath \
--outtype f16 \
--model-name "model-tune-name"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment