Skip to content

Instantly share code, notes, and snippets.

View thelazt16's full-sized avatar

Febri Eka Setyawan thelazt16

5 followers · 11 following
View GitHub Profile
@thelazt16
thelazt16 / INSTALL.md
Last active June 20, 2024 20:17 — forked from askareija/INSTALL.md
Install Ollama with AMD GPU (On Laptop) Arch Linux
  1. Clone ollama git clone --recursive https://github.com/ollama/ollama.git
  2. go to directory cd ollama
  3. Install dependencies sudo pacman -S rocm-hip-sdk rocm-opencl-sdk clblast go
  4. Build ollama with env AMDGPU_TARGET=gfx1030 ROCM_PATH=/opt/rocm CLBlast_DIR=/usr/lib/cmake/CLBlast go generate -tags rocm ./...
  5. go build -tags rocm
  6. Now to run it HSA_OVERRIDE_GFX_VERSION=10.3.0 ./ollama serve

More info : https://blog.rabu.me/ollama-running-on-an-amd-gpu/

GPU Support : https://github.com/ollama/ollama/blob/main/docs/gpu.md