Skip to content

Instantly share code, notes, and snippets.

@andreanidouglas

andreanidouglas/ollama-webui-gpu.yml

Last active April 1, 2025 13:39
Show Gist options
  • Save andreanidouglas/d108828e2e8cf3f0f0bdcac8b78b2a09 to your computer and use it in GitHub Desktop.
Save andreanidouglas/d108828e2e8cf3f0f0bdcac8b78b2a09 to your computer and use it in GitHub Desktop.
Download ZIP
Docker compose to run ollama web-ui with gpu attached
Raw
ollama-webui-gpu.yml
services:
ollama:
image: ollama/ollama:latest
ports:
- 11434:11434
volumes:
- ollama:/root/.ollama
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: 1
capabilities: [gpu]
webui:
image: ghcr.io/open-webui/open-webui:main
ports:
- 8080:8080
volumes:
- webui:/app/backend/data
environment:
- OLLAMA_BASE_URL=http://ollama:11434
volumes:
ollama:
webui:
Raw
ollama-webui-pi.yml
services:
ollama:
image: ollama/ollama:latest
ports:
- 11434:11434
volumes:
- ollama:/root/.ollama
webui:
image: ghcr.io/open-webui/open-webui:main
ports:
- 8080:8080
volumes:
- webui:/app/backend/data
environment:
- OLLAMA_BASE_URL=http://ollama:11434
volumes:
ollama:
webui:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment