Skip to content

Instantly share code, notes, and snippets.

@jameswnl
Created February 28, 2025 01:52
Show Gist options
  • Save jameswnl/29edf4971a283ca17b114886c29144bc to your computer and use it in GitHub Desktop.
Save jameswnl/29edf4971a283ca17b114886c29144bc to your computer and use it in GitHub Desktop.
As of llama-stack 0.1.2. Using template ollama
version: '2'
distribution_spec:
description: Use (an external) Ollama server for running LLM inference
container_image: null
providers:
inference:
- remote::ollama
vector_io:
- inline::faiss
- remote::chromadb
- remote::pgvector
safety:
- inline::llama-guard
agents:
- inline::meta-reference
telemetry:
- inline::meta-reference
eval:
- inline::meta-reference
datasetio:
- remote::huggingface
- inline::localfs
scoring:
- inline::basic
- inline::llm-as-judge
- inline::braintrust
tool_runtime:
- remote::brave-search
- remote::tavily-search
- inline::code-interpreter
- inline::rag-runtime
image_type: conda
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment