tysam-code’s gists

tysam-code / diloco_1800_steps_big_adam_params_nesterov_warmup_run2_release.log

Created May 30, 2025 21:36

	import os
	import sys
	with open(sys.argv[0]) as f:
	code = f.read() # read the code of this file ASAP, for logging
	import uuid
	import time
	import glob
	import subprocess
	import contextlib
	from dataclasses import dataclass

tysam-code / diloco_nesterov_.7lr_.0_to_.9_momentum_1000_momentum_warmup_1-momentum_dampening_dampening_initial_step_bugfix_25_steps_all_outer_opt_lr_cooldown_outer_opt_lr_crossfade_run2.log

Created May 29, 2025 21:53

	import os
	import sys
	with open(sys.argv[0]) as f:
	code = f.read() # read the code of this file ASAP, for logging
	import uuid
	import time
	import glob
	import subprocess
	import contextlib
	from dataclasses import dataclass

tysam-code / diloco_5_14_run_log

Created May 14, 2025 22:39

	import os
	import sys
	with open(sys.argv[0]) as f:
	code = f.read() # read the code of this file ASAP, for logging
	import uuid
	import time
	import glob
	import subprocess
	import contextlib
	from dataclasses import dataclass

tysam-code / diloco_nesterov_.7lr_.0_to_.9_momentum_1000_momentum_warmup_1-momentum_dampening_dampening_initial_step_bugfix_25_steps_all_run3.log

Created April 30, 2025 00:56

diloco_nesterov_.7lr_.0_to_.9_momentum_1000_momentum_warmup_1-momentum_dampening_dampening_initial_step_bugfix_25_steps_all_run3.log

	import os
	import sys
	with open(sys.argv[0]) as f:
	code = f.read() # read the code of this file ASAP, for logging
	import uuid
	import time
	import glob
	import subprocess
	import contextlib
	from dataclasses import dataclass

tysam-code / train_gpt_011525_record.py

Created January 16, 2025 00:29

	import os
	import sys
	with open(sys.argv[0]) as f:
	code = f.read() # read the code of this file ASAP, for logging
	import uuid
	import time
	import glob
	import subprocess
	import contextlib
	from dataclasses import dataclass

tysam-code / fern_resume.txt

Last active April 10, 2025 16:51

	# NOTE: Resume originally formatted to fit a standard terminal screen (80 px)

	Fern Balsam (she/they)
	community-funded open-source ml researcher / part-time outdoor adventurer
	9 years of experience developing and aggressively optimizing neural networks
	[ primary ] goal: societal impact via applied research and surrounding work
	[ secondary ] goal: pure research extending theory of deep learning
	-------------------------------------------------------------------------------
	\| \|
	\| Achievements \|

tysam-code / gist:6147e4fb218f35325af82254a229861a

Created January 15, 2025 00:12

	# NOTE: Resume originally formatted to fit a standard terminal screen (80 px)

	Fern Balsam (she/they)
	community-funded open-source ml researcher / part-time outdoor adventurer
	9 years of experience developing and aggressively optimizing neural networks
	[ primary ] goal: societal impact via applied research and surrounding work
	[ secondary ] goal: pure research extending theory of deep learning
	-------------------------------------------------------------------------------
	\| \|
	\| Achievements \|

tysam-code / hlb-cifar10-ternary-train-initial-working-prototype.py

Last active December 29, 2023 07:47

Trains a network to ~>91.5% on CIFAR10 in less than 10 seconds on an A100 with ternary weights, should fit uncompressed w/ correct storage dtypes in just over half of a floppy drive. <3 :'))))

	# Note: The one change we need to make if we're in Colab is to uncomment this below block.
	# If we are in an ipython session or a notebook, clear the state to avoid bugs
	"""
	try:
	_ = get_ipython().__class__.__name__
	## we set -f below to avoid prompting the user before clearing the notebook state
	%reset -f
	except NameError:
	pass ## we're still good
	"""

tysam-code / discrete-action-backprop-bypass-hlb-cifar10-demo.py

Last active March 14, 2024 09:24

This is a network sketch. Network sketches aren't complete, released versions, but rather a (hopefully convincing) proof-of-concept of a particular idea. The intent of this network sketch is to show that traditional backprop is not required in order to learn and coordinate a network's dataflow structure over a simulated discrete, non-backproppab…

	# Sketch-specific note: a roughly ~25 run battery for this code estimated a roughly ~93.11% accuracy in the same number of steps as the baseline network, ~1.7x runtime overhead (much of which goes to the torch.randn allocations and extra layer calculations).

	# Note: The one change we need to make if we're in Colab is to uncomment this below block.
	# If we are in an ipython session or a notebook, clear the state to avoid bugs
	#"""
	try:
	_ = get_ipython().__class__.__name__
	## we set -f below to avoid prompting the user before clearing the notebook state
	%reset -f
	except NameError:

tysam-code / in_dev_slicer_prefetcher.py

Last active December 15, 2023 06:44

in dev, TODO fill out description later.

	import os
	import time
	import queue
	import threading
	import random

	import torch
	import torchvision
	from torchvision.transforms import v2

Fern tysam-code