jairusr

mkdir -p ~/repositories
cd ~/repositories
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp

sudo pacman -S --needed base-devel git cmake rocm-hip-sdk rocm-llvm

Inspired by https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md
cmake -B build \
  -DGGML_HIP=ON \

jairusr

This is the output of three commands:

Systemd service sed -n '1,240p' /etc/systemd/system/llama-qwen36-mtp.service

Shell with my qwen config sed -n '1,260p' /home/jai/.local/bin/run-qwen36-mtp-q8.sh

Rocm-Smi