Skip to content

Instantly share code, notes, and snippets.

@flyingoctopus
Last active November 6, 2024 01:47
Show Gist options
  • Save flyingoctopus/e36f6239b78f85977dc58467881b294a to your computer and use it in GitHub Desktop.
Save flyingoctopus/e36f6239b78f85977dc58467881b294a to your computer and use it in GitHub Desktop.
privateGPT on apple silicon
# pull project
git clone https://github.com/imartinez/privateGPT && cd privateGPT
# install make and miniconda, follow the miniconda enironment setup steps
brew install make miniconda
# get Python 3.11 and poetry in a isolated conda environment
conda create privategpt python=3.11 && conda use privategpt && pip install poetry
# installing my chosen dependencies
poetry install --extras "ui llms-ollama"
# INSTALL OLLAMA
# FROM ollama.com
# .................installed :)# Install ollama models
ollama pull mistral
ollama pull nomic-embed-text
# install other dependencies
poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant"
# TROUBLESHOOTING
# during this installation you might need to run
# pip install --upgrade poetry
# pip install --upgrade build
# Finally...
PGPT_PROFILES=ollama make run
# Now open up the IP address on your browser
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment