Skip to content

Instantly share code, notes, and snippets.

@mldk-tech

mldk-tech/gist:5ce7258de64fab8466b6cf3330107fb2

Forked from mberman84/gist:45545e48040ef6aafb6a1cb3442edb83
Created August 3, 2023 08:59
Show Gist options
  • Save mldk-tech/5ce7258de64fab8466b6cf3330107fb2 to your computer and use it in GitHub Desktop.
Save mldk-tech/5ce7258de64fab8466b6cf3330107fb2 to your computer and use it in GitHub Desktop.
Download ZIP
LLaMA 2 13b chat fp16 Install Instructions
Raw
gistfile1.txt
conda create -n textgen python=3.10.9
conda activate textgen
install pytorch: pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
git clone https://github.com/oobabooga/text-generation-webui
cd text-generation-webui
pip install -r requirements.txt
python server.py
# download model
# refresh model list
# load model
# switch to chat mode
@mldk-tech
Copy link
Author

For LAMMA2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment