Skip to content

Instantly share code, notes, and snippets.

@jkeam

jkeam/local-llama.md

Created January 23, 2024 18:43
Show Gist options
  • Save jkeam/9e6c49140dcb9eb606c5a4a767d3cdf0 to your computer and use it in GitHub Desktop.
Save jkeam/9e6c49140dcb9eb606c5a4a767d3cdf0 to your computer and use it in GitHub Desktop.
Download ZIP
Running Local Llama
Raw
local-llama.md

Running Local Llama

Installation

I'm using a Mac, sooooooooooo these instructions are Apple-esque.

brew install ollama

Running

  1. Start the server

    ollama serve

  2. Run model

    ollama run llama2

  3. Profit! Start talking to the bot!

@jkeam
Copy link
Author

jkeam commented Jan 29, 2024

You can run other models! See here: https://github.com/ollama/ollama?tab=readme-ov-file#model-library

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment