Skip to content

Instantly share code, notes, and snippets.

@casbeebc

casbeebc/llama.cpp.ubuntu.via.wsl2.install

Created September 14, 2025 17:07
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save casbeebc/ce5107558c5ab07102a27ab77de6a0cc to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save casbeebc/ce5107558c5ab07102a27ab77de6a0cc to your computer and use it in GitHub Desktop.
Download ZIP
Install LLAMA.CPP in UBUNTU WSL2
Raw
llama.cpp.ubuntu.via.wsl2.install
### VERSION 13 on 2025-09-14 ###
export CC=/usr/bin/gcc-13
export CXX=/usr/bin/g++-13
export CUDAHOSTCXX=/usr/bin/g++-13
CUDACXX=/usr/local/cuda-13/bin/nvcc CMAKE_ARGS="-DGGML_CUDA=on -DCMAKE_CUDA_ARCHITECTURES=all-major" FORCE_CMAKE=1 pip install llama-cpp-python --no-cache-dir --force-reinstall --upgrade
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment