Skip to content

Instantly share code, notes, and snippets.

@mberman84

mberman84/gist:9b3c281ae5e3e92b7e946f6a09787cde

Created November 9, 2023 15:39
Show Gist options
  • Save mberman84/9b3c281ae5e3e92b7e946f6a09787cde to your computer and use it in GitHub Desktop.
Save mberman84/9b3c281ae5e3e92b7e946f6a09787cde to your computer and use it in GitHub Desktop.
Download ZIP
PrivateGPT Installation
Raw
gistfile1.txt
# Clone the repo
git clone https://github.com/imartinez/privateGPT
cd privateGPT
# Install Python 3.11
pyenv install 3.11
pyenv local 3.11
# Install dependencies
poetry install --with ui,local
# Download Embedding and LLM models
poetry run python scripts/setup
# (Optional) For Mac with Metal GPU, enable it. Check Installation and Settings section
to know how to enable GPU on other platforms
CMAKE_ARGS="-DLLAMA_METAL=on" pip install --force-reinstall --no-cache-dir llama-cpp-python
# Run the local server
PGPT_PROFILES=local make run
# Note: on Mac with Metal you should see a ggml_metal_add_buffer log, stating GPU is
being used
# Navigate to the UI and try it out!
http://localhost:8001/
@0xj0n1
Copy link

0xj0n1 commented Feb 17, 2025

Is there a good tutorial for ubuntu out there? Just curious

@quincy451
Copy link

Is there a good tutorial for ubuntu out there? Just curious

I do not have an answer to your question, but having successfully done the windows version I wonder if you can’t just follow the Linux version of that. The privategpt instructions have gotten better for windows and Linux is embedded in that. Might look at that, I know I am going to do that. As I have a container use case and Linux is a better fit for that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment