Skip to content

Instantly share code, notes, and snippets.

@ryanhs

ryanhs/docker run example.sh

Created May 19, 2024 13:56
Show Gist options
  • Save ryanhs/0fe15e58b75efba1d418580ec35c5430 to your computer and use it in GitHub Desktop.
Save ryanhs/0fe15e58b75efba1d418580ec35c5430 to your computer and use it in GitHub Desktop.
Download ZIP
ollama run on docker, with cpu limit
Raw
docker run example.sh
#!/bin/bash
docker run --rm -it -v /usr/share/ollama/.ollama/:/root/.ollama -p 11435:11434 --cpuset-cpus=0,1 ollama/ollama
docker run --rm -it -v /usr/share/ollama/.ollama/:/root/.ollama -p 11436:11434 --cpuset-cpus=2,3 ollama/ollama
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment