Skip to content

Instantly share code, notes, and snippets.

View gtzilla's full-sized avatar

gregory tomlinson gtzilla

View GitHub Profile

LLM Wiki

A pattern for building personal knowledge bases using LLMs.

This is an idea file, it is designed to be copy pasted to your own LLM Agent (e.g. OpenAI Codex, Claude Code, OpenCode / Pi, or etc.). Its goal is to communicate the high level idea, but your agent will build out the specifics in collaboration with you.

The core idea

Most people's experience with LLMs and documents looks like RAG: you upload a collection of files, the LLM retrieves relevant chunks at query time, and generates an answer. This works, but the LLM is rediscovering knowledge from scratch on every question. There's no accumulation. Ask a subtle question that requires synthesizing five documents, and the LLM has to find and piece together the relevant fragments every time. Nothing is built up. NotebookLM, ChatGPT file uploads, and most RAG systems work this way.

@gtzilla
gtzilla / module_initialized.commander.js
Last active December 2, 2018 11:47
Parse alternate to `process.argv`. IF/ELSE loads from CLI and loads from inclusion in another script
/*
initialize from alternate in CLI commander.js script
Included as a module in nodejs
instead of process.argv
https://github.com/tj/commander.js/
*/
if (require.main === module) {
@gtzilla
gtzilla / helpers.js
Last active May 2, 2016 12:04
JavaScript closure state manager for a single argument, with support for default state initialization value. A JavaScript private variables method.
;(function(window) {
'use strict';
/**
filename: helpers.js
author: gregory tomlinson
license: MIT
Be a "utility" helper method
file that is namespaced to 'helpers'
@ColinEberhardt
ColinEberhardt / .block
Last active October 27, 2019 20:05
d3fc-label-layout map example
license: mit
@gabrielelana
gabrielelana / Vagrantfile
Last active January 2, 2024 18:58
How to create a VirtualBox machine with encrypted storage with Vagrant
# -*- mode: ruby -*-
# vi: set ft=ruby :
PASSWORD_PATH = ".password"
PASSWORD_ID_PATH = ".password_id"
# Make sure to have installed vagrant-triggers plugin
# > vagrant plugin install vagrant-triggers
# After the first `vagrant up` stop the VM and execute the following steps
# FIXME This is a **terrible** hack. This logic should really be
# in the model. It's very difficult to put it there because we
# can only perform index updates here, in the API layer, because
# of the way we mix sync/async code. You should be shaking your
# head in disgust the entire time you read this code and be
# thinking, "What kind of fucking muppet would even think this is
# a good idea?! ZOMG!!"
@gtzilla
gtzilla / regex_compile_test2.js
Created October 26, 2011 07:49
Regex Test, consistent fail on every other when matching - or !
var raw_str_regex = "-([a-zA-Z0-9_]+)$";
var regex = new RegExp(raw_str_regex, "gm");
var lst = [
"this is -not",
"this is -not",
"this is -not",
"this is -not",
"this is -not",
"this is -not"
@alexalemi
alexalemi / twittercompress.py
Created August 31, 2011 03:24
Twitter Compression
""" A script to attempt the compression of written english
to the chinese character set """
import os
from collections import OrderedDict
from math import log
import itertools
from collections import Counter
"""Monads in Python, as close as I can get them to
Haskell
"""
class Monad(object):
def return_(self, value):
raise NotImplementedError()
def __ge__(self, mf):
raise NotImplementedError()
@apg
apg / p.py
Created April 11, 2011 20:56
def charorquoted(strn):
c = anychar(strn)
if c[0] == '"':
return None
elif c[0] == '\\':
c2 = anychar(c[1])
if c2[0] in ('\\', '"'):
return (c[0] + c2[0], c2[1])
else:
return c