Skip to content

Instantly share code, notes, and snippets.

@repen

repen/gist:a0122edda9cdec3d92d02f8a586f0105

Created April 5, 2026 16:17
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save repen/a0122edda9cdec3d92d02f8a586f0105 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save repen/a0122edda9cdec3d92d02f8a586f0105 to your computer and use it in GitHub Desktop.
Download ZIP
llama.cpp build
Raw
gistfile1.txt
sudo apt update
git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp
https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_local
cmake -B build -DGGML_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=89
cmake --build build --config Release -j$(nproc)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment