Skip to content

Instantly share code, notes, and snippets.

View paoloaveri's full-sized avatar

paoloaveri

1 follower · 0 following
View GitHub Profile
@paoloaveri
paoloaveri / README.md
Created November 7, 2025 07:11
Running llama.cpp on GPU on Intel Mac

I found a way to run llama.cpp with GPU support on my 2019 Intel MacBook Pro, with the help of Vulkan.

Thanks to ollama/ollama#1016 (comment) an following comments which helped me find the right build flags.

First download MoltenVK-macos.tar (I used v1.3.0-rc1 at the time) from https://github.com/KhronosGroup/MoltenVK/releases

Not sure all these packages are required, but I ran brew install libomp vulkan-headers glslang molten-vk shaderc vulkan-loader. You probably also need to install cmake and potentially other tools I already had installed on my system.

Then clone and build llama.cpp (replace /path/to/MoltenVK_macos with the actual path you have MoltenVK_macos):