Skip to content

Instantly share code, notes, and snippets.

View CodingCanuck's full-sized avatar

Xander McCarthy CodingCanuck

View GitHub Profile

Run with Claude Code

When running with claude code, certain things don't work (e.g. the web_search tool, or running agents in parallel). Inference is slower than with Claude, and results are worse.

Install llama.cpp and set up qwen3-coder per these instructions: https://docs.unsloth.ai/basics/qwen3-coder-how-to-run-locally#run-qwen3-coder-30b-a3b-instruct

As of 2025/08/17, you need to download the fixed ninja chat template per these instructions: https://docs.unsloth.ai/basics/qwen3-coder-how-to-run-locally#tool-calling-fixes

Install claude-code-router per these instructions: https://github.com/musistudio/claude-code-router?tab=readme-ov-file#-getting-started