Skip to content

Instantly share code, notes, and snippets.

@lvnilesh

lvnilesh/config.yml

Created July 4, 2026 06:35
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save lvnilesh/162747ff7d164efadfc4c0aeced0a942 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save lvnilesh/162747ff7d164efadfc4c0aeced0a942 to your computer and use it in GitHub Desktop.
Download ZIP
oh-my-pi config
Raw
config.yml
setupVersion: 1
modelRoles:
default: "local-llama/unsloth/Qwen3.6-27B-GGUF"
smol: "local-llama/unsloth/Qwen3.6-27B-GGUF"
slow: "nuc-vision/qwen2.5-vl-7b"
task: "local-llama/unsloth/Qwen3.6-27B-GGUF"
plan: "local-llama/unsloth/Qwen3.6-27B-GGUF"
advisor: "local-llama/unsloth/Qwen3.6-27B-GGUF"
# Intercept context compression and throw it to the NUC
compaction:
strategy: "snapcompact"
enabled: true
remoteEnabled: true
# Use local 27B for compaction — smarter summarization, no mmproj needed
remoteEndpoint: "http://127.0.0.1:8001/v1/chat/completions"
tools:
web_search:
provider: "searxng"
providers:
webSearch: "searxng"
searxng:
endpoint: "http://127.0.0.1:4040"
memory:
backend: "local"
Raw
models.yml
setupVersion: 1
modelRoles:
default: "local-llama/unsloth/Qwen3.6-27B-GGUF"
smol: "local-llama/unsloth/Qwen3.6-27B-GGUF"
slow: "nuc-vision/qwen2.5-vl-7b"
task: "local-llama/unsloth/Qwen3.6-27B-GGUF"
plan: "local-llama/unsloth/Qwen3.6-27B-GGUF"
advisor: "local-llama/unsloth/Qwen3.6-27B-GGUF"
# Intercept context compression and throw it to the NUC
compaction:
strategy: "snapcompact"
enabled: true
remoteEnabled: true
# Use local 27B for compaction — smarter summarization, no mmproj needed
remoteEndpoint: "http://127.0.0.1:8001/v1/chat/completions"
tools:
web_search:
provider: "searxng"
providers:
webSearch: "searxng"
searxng:
endpoint: "http://127.0.0.1:4040"
memory:
backend: "local"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment