Skip to content

Instantly share code, notes, and snippets.

@mrseanryan
Last active January 21, 2024 10:46
Show Gist options
  • Save mrseanryan/54a411dd1849578724b0157fb0e83b40 to your computer and use it in GitHub Desktop.
Save mrseanryan/54a411dd1849578724b0157fb0e83b40 to your computer and use it in GitHub Desktop.
[blocks instance booting!] AWS EC2 User Data script to launch text-generation-webui on Instance Launch
#cloud-boothook
#!/bin/bash
cd /home/ubuntu/text-generation-webui
GPU_CHOICE=A USE_CUDA118=FALSE LAUNCH_AFTER_INSTALL=TRUE INSTALL_EXTENSIONS=TRUE ./start_linux.sh --public-api --extensions openai --api-port 5000 --auto-devices --gpu-memory 24
# --share
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment