Aaron a0n

a0n / j6b_train_hf_ds.py

Created August 23, 2021 07:38 — forked from kinoc/j6b_train_hf_ds.py

So now you want to finetune that GPT-J-6B on a 3090/TITAN GPU ... okay, using HF and DeepSpeed too

	# So now you want to finetune that GPT-J-6B on a 3090/TITAN GPU ... okay
	# More exploratory coding. It uses the Huggingface model port, deepspeed and reads all text/md files from a target directory
	# It is a fragment of a larger system with remote editing, but that's another story
	# This is the raw, training tester. Items to look out for:
	# - uses DeepSpeed and has a DS config
	# - to save space uses SGD instead of ADAM
	# - uses gradient checkpointing
	# - freezes 25% of the layers to fit

	# Assumes you can already run https://gist.github.com/kinoc/2d636a68876cd3de7b6e9c9452b61089

a0n / upgrade_raspbian_to_buster.sh

Last active July 8, 2019 03:46 — forked from nickfox-taterli/upgrade_raspbian_to_buster.sh

Upgrade Raspbian To Buster

	#!/bin/bash
	sudo bash -c "sync \
	&& apt-get update \
	&& apt-get -y upgrade \
	&& apt-get -y dist-upgrade \
	&& sed -i 's/stretch/buster/g' /etc/apt/sources.list \
	&& sed -i 's/stretch/buster/g' /etc/apt/sources.list.d/raspi.list \
	&& apt-get update \
	&& apt-get -y upgrade \
	&& apt-get -y dist-upgrade \

a0n / atomsettings

Last active August 12, 2018 19:38

automatic update by http://atom.io/packages/sync-settings


	a

a0n / install_fabio.sh

Last active June 24, 2017 00:27

install fabio

	#!/bin/bash

	systemctl stop fabio;
	killall fabio;
	rm -f `which fabio`;
	rm -f `which fabio`;

	wget -O /usr/sbin/fabio "https://github.com/fabiolb/fabio/releases/download/v1.5.0/fabio-1.5.0-go1.8.3-linux_amd64"

a0n / gist:1989912

Created March 6, 2012 23:57

npm fails to install dependencies

	a0n.lan ➜ ~/Code/new_rewrite/server2 npm install
	npm http GET https://registry.npmjs.org/ss-coffee
	npm http GET https://registry.npmjs.org/ss-stylus
	npm http GET https://registry.npmjs.org/ss-jade
	npm http GET https://registry.npmjs.org/ss-hogan
	npm http 304 https://registry.npmjs.org/ss-stylus
	npm http 304 https://registry.npmjs.org/ss-jade
	npm http 304 https://registry.npmjs.org/ss-coffee
	npm http 304 https://registry.npmjs.org/ss-hogan
	npm http GET https://registry.npmjs.org/coffee-script