Skip to content

Instantly share code, notes, and snippets.

@florinel-chis

florinel-chis/llama-compile.sh

Last active February 10, 2025 14:27
Show Gist options
  • Save florinel-chis/9e421f6f8e06fc0ade3ec9cced0811d2 to your computer and use it in GitHub Desktop.
Save florinel-chis/9e421f6f8e06fc0ade3ec9cced0811d2 to your computer and use it in GitHub Desktop.
Download ZIP
llama compile on cpu
Raw
llama-compile.sh
sudo apt install libcurl4-openssl-dev
mkdir build
cd build/
CXX=g++-10 cmake -DLLAMA_NATIVE=OFF -DLLAMA_AVX=OFF -DLLAMA_STATIC=ON -DCMAKE_BUILD_TYPE=Release -DLLAMA_ACCELERATE=OFF -DLLAMA_METAL=OFF -DLLAMA_CUBLAS=OFF -DLLAMA_CURL=ON ..
make -j4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment