-
Check status from terminal:
nvidia-smi. -
Skip this step if you have the following output:
+-----------------------------------------------------------------------------+
| # So you want to run GPT-J-6B using HuggingFace+FastAPI on a local rig (3090 or TITAN) ... tricky. | |
| # special help from the Kolob Colab server https://colab.research.google.com/drive/1VFh5DOkCJjWIrQ6eB82lxGKKPgXmsO5D?usp=sharing#scrollTo=iCHgJvfL4alW | |
| # Conversion to HF format (12.6GB tar image) found at https://drive.google.com/u/0/uc?id=1NXP75l1Xa5s9K18yf3qLoZcR6p4Wced1&export=download | |
| # Uses GDOWN to get the image | |
| # You will need 26 GB of space, 12+GB for the tar and 12+GB expanded (you can nuke the tar after expansion) | |
| # Near Simplest Language model API, with room to expand! | |
| # runs GPT-J-6B on 3090 and TITAN and servers it using FastAPI | |
| # change "seq" (which is the context size) to adjust footprint |
| #!/usr/bin/env bash | |
| set -e | |
| # See also: https://github.com/frost-nzcr4/find_forks (same thing but in python) | |
| origin_url="$(git config --get remote.origin.url | sed 's+.*: ++')" | |
| full_repo_name="$(echo "$origin_url" | sed 's+.*github.com/++ ; s+\.git$++')" | |
| forks_url="https://api.github.com/repos/${full_repo_name}/forks" |
| sudo yum update | |
| # Installing ZSH | |
| sudo yum -y install zsh | |
| # Check ZSH has been installed | |
| zsh --version | |
| # Install "util-linux-user" because "chsh" is not available by default | |
| # See https://superuser.com/a/1389273/599050 |
| #!/usr/bin/env bash | |
| # Author: Oleh Pshenychnyi | |
| # Date: 13.02.2021 | |
| # | |
| # Kill all processes matching a provided pattern. | |
| # | |
| # Usage: | |
| # | |
| # >> bash killer.sh celery |
| // To use this, put it in a folder, install ytdl-core with `npm i ytdl-core`, then create a ZIP with the content of the folder and deploy it. | |
| // https://docs.aws.amazon.com/lambda/latest/dg/nodejs-package.html#nodejs-package-dependencies | |
| var AWS = require('aws-sdk'); | |
| const ytdl = require('ytdl-core'); | |
| const stream = require('stream'); | |
| var s3 = new AWS.S3(); | |
| exports.handler = async (event, context, cb) => { | |
| const { videoUrl, key, bucket } = event; |
| FROM ubuntu:20.04 | |
| LABEL "MAINTAINER" "Peter McConnell <me@petermcconnell.com>" | |
| SHELL ["/bin/bash", "-eo", "pipefail", "-c"] | |
| RUN apt-get update && \ | |
| DEBIAN_FRONTEND=noninteractive \ | |
| apt-get install -yq --no-install-recommends \ | |
| xauth \ | |
| openssh-server \ |
| sudo apt update | |
| sudo apt install fuse libfuse-dev libicu-dev bzip2 libbz2-dev cmake git libattr1-dev zlib1g-dev g++ | |
| sudo snap install cmake --classic | |
| git clone https://github.com/sgan81/apfs-fuse.git | |
| cd apfs-fuse | |
| git submodule init | |
| git submodule update | |
| mkdir build |