Mike Staub mikestaub

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Pre-Transformer Models

macOS Internals

Understand your Mac and iPhone more deeply by tracing the evolution of Mac OS X from prelease to Swift. John Siracusa delivers the details.

Starting Points

How to use this gist

You've got two main options:

Paleotemperature Hockey Sticks

This is a list of paleoclimate studies [2–63] that use a variety of temperature proxies and methodologies in affirmation of Michael Mann's hockey stick result [1], which shows strong recent hemispheric and global warming. The last column provides an exemplary figure from each paper.

The original MBH98 paper [1] has so far been cited 1200+ times (Web of Science).

N.B. For the original text list without hyperlinks or figures, go here. It's still being updated.

What do paleotemperature studies tell us in general?

Schemas Design Doc (draft)

Please note: The following document is an initial draft proposal. All decisions are subject to change. Our present goal is to collect feedback and iterate upon this document. Please feel free to share your suggestions and concerns.

Overview

ADX is a federated network for distributing data. It leverages cryptographic signatures and hashes to distribute authenticity proofs along with the data, enabling each node to transact upon the data independently of the data's origin. ADX might therefore be described as an Internet-native database in which records are replicated across nodes.

As a consequence of relying on authenticity proofs, ADX must exchange "canonical" records. That is, ADX records must be transmitted in their original encoding and structure in order to validate the signatures and hashes which comprise the proofs. This stands in contrast to the RESTful model of the Web in which "representations" of records are exchanged and therefore may be constructed at the ti

Introduction

I'm Ruben "Bitcoin Sorcerer" Somsen. I do protocol design in order to enhance Bitcoin - SwiftSync, Silent Payments, Spacechains, Statechains, and more.

I'm co-founder/director of the 2140 Foundation together with Josie. We're a stable and independent European hub for Bitcoin development with a physical office in Amsterdam, focused on increasing developer satisfaction, growth, and productivity.

I moderate the bitcoindev mailing list and am involved with the BIP editor process, Delving Bitcoin, and BitDevs Amsterdam. In the past I've run the Seoul Bitcoin Meetup (2014-2020) and co-hosted the Unhashed Podcast (2018-2022).

I

Moved to Shopify/graphql-design-tutorial

	"""
	The most atomic way to train and run inference for a GPT in pure, dependency-free Python.
	This file is the complete algorithm.
	Everything else is just efficiency.

	@karpathy
	"""

	import os # os.path.exists
	import math # math.log, math.exp

	#!/usr/bin/env ruby

	# https://asmirnov.xyz/vram
	# https://vram.asmirnov.xyz

	require "fileutils"
	require "json"
	require "open-uri"

	# https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator/blob/main/index.html

	#!/usr/bin/env bash

	set -e

	cd ~

	sudo -v

	# Make sure system is in a good, updated, clean, state.
	sudo apt-get -y update

	Infographics: https://i.imgur.com/zGygu4U.jpg

	Luke Dashjr, a prolific Bitcoin Core developer, has been sent to Twitter jail: he received a permanent suspension for proclaiming he'll respond with appropriate force if anyone tries to force vaccination on him or his family. To avoid confusion it's important to clarify he does not have an anti-vaccine stance, rather he took a wait for more data approach instead.

	Bitcoin is the future of money, a technology that is as fundamental to humanity as speech itself. It is paramount for mankind to thrive. Luke spent over a decade working on this technology, therefore taking away his access to public communication channels is great disservice to society itself.

	Flexes:

	- Core dev
	- BIP maintainer