Last active
November 6, 2024 01:47
-
-
Save flyingoctopus/e36f6239b78f85977dc58467881b294a to your computer and use it in GitHub Desktop.
privateGPT on apple silicon
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# pull project | |
git clone https://github.com/imartinez/privateGPT && cd privateGPT | |
# install make and miniconda, follow the miniconda enironment setup steps | |
brew install make miniconda | |
# get Python 3.11 and poetry in a isolated conda environment | |
conda create privategpt python=3.11 && conda use privategpt && pip install poetry | |
# installing my chosen dependencies | |
poetry install --extras "ui llms-ollama" | |
# INSTALL OLLAMA | |
# FROM ollama.com | |
# .................installed :)# Install ollama models | |
ollama pull mistral | |
ollama pull nomic-embed-text | |
# install other dependencies | |
poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant" | |
# TROUBLESHOOTING | |
# during this installation you might need to run | |
# pip install --upgrade poetry | |
# pip install --upgrade build | |
# Finally... | |
PGPT_PROFILES=ollama make run | |
# Now open up the IP address on your browser |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment