Skip to content

Instantly share code, notes, and snippets.

View agustinsacco's full-sized avatar

Agustin Sacco agustinsacco

6 followers · 0 following
View GitHub Profile
@agustinsacco
agustinsacco / qwen3.6-llamacpp-mtp-vision.md
Created June 25, 2026 14:05
Local Qwen 3.6 35B-A3B (Q8) Setup with llama.cpp, MTP & Vision

Local Qwen 3.6 35B-A3B (Q8) Setup with llama.cpp, MTP & Vision

A complete, reproducible guide for running Qwen 3.6 35B-A3B (Q8_K quant) locally with Multi-Token Prediction (MTP) and image/vision support using llama.cpp.

📥 1. Download from Hugging Face

# Option A: huggingface-cli (recommended for large models)