Skip to content

Instantly share code, notes, and snippets.

@benarent
Created August 28, 2024 00:02
Show Gist options
  • Save benarent/12a6ab5a4a86844a2cf88e3c4e0a05fa to your computer and use it in GitHub Desktop.
Save benarent/12a6ab5a4a86844a2cf88e3c4e0a05fa to your computer and use it in GitHub Desktop.
version: '3.8'
services:
ollama:
image: ollama/ollama
container_name: ollama
ports:
- 11434:11434
volumes:
- ./ollama:/root/.ollama
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: all
capabilities: [gpu]
open-webui:
image: ghcr.io/open-webui/open-webui:main
container_name: open-webui
ports:
- 3000:8080
environment:
- OLLAMA_API_BASE_URL=http://ollama:11434
volumes:
- ./open-webui:/app/backend/data
depends_on:
- ollama
weaviate:
image: semitechnologies/weaviate:1.21.5
container_name: weaviate
ports:
- 8080:8080
environment:
QUERY_DEFAULTS_LIMIT: 25
AUTHENTICATION_ANONYMOUS_ACCESS_ENABLED: 'true'
PERSISTENCE_DATA_PATH: '/var/lib/weaviate'
DEFAULT_VECTORIZER_MODULE: 'none'
CLUSTER_HOSTNAME: 'node1'
volumes:
- ./weaviate_data:/var/lib/weaviate
volumes:
ollama:
open-webui:
weaviate_data:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment