Akram Zaytar Akramz

LLM Wiki

A pattern for building personal knowledge bases using LLMs.

This is an idea file, it is designed to be copy pasted to your own LLM Agent (e.g. OpenAI Codex, Claude Code, OpenCode / Pi, or etc.). Its goal is to communicate the high level idea, but your agent will build out the specifics in collaboration with you.

The core idea

Most people's experience with LLMs and documents looks like RAG: you upload a collection of files, the LLM retrieves relevant chunks at query time, and generates an answer. This works, but the LLM is rediscovering knowledge from scratch on every question. There's no accumulation. Ask a subtle question that requires synthesizing five documents, and the LLM has to find and piece together the relevant fragments every time. Nothing is built up. NotebookLM, ChatGPT file uploads, and most RAG systems work this way.

	"""
	The most atomic way to train and run inference for a GPT in pure, dependency-free Python.
	This file is the complete algorithm.
	Everything else is just efficiency.

	@karpathy
	"""

	import os # os.path.exists
	import math # math.log, math.exp

	# train_grpo.py
	#
	# See https://github.com/willccbb/verifiers for ongoing developments
	#
	"""
	citation:

	@misc{brown2025grpodemo,
	title={Granular Format Rewards for Eliciting Mathematical Reasoning Capabilities in Small Language Models},
	author={Brown, William},

	"""This is a heavily adapted version of the code from https://github.com/ThomasWangWeiHong/Simple-Pansharpening-Algorithms.

	Some useful resources about pansharpening:
	- https://github.com/mapbox/rio-pansharpen
	- https://github.com/gerasimosmichalitsianos/pansharpen
	- https://desktop.arcgis.com/en/arcmap/latest/manage-data/raster-and-images/fundamentals-of-panchromatic-sharpening.htm
	- https://gist.github.com/celoyd/5bb5417b24801e0446ad5977cc3581e4
	"""
	import os
	from typing import Any, Dict, List, Optional

	var sentinel1 = ee.ImageCollection('COPERNICUS/S1_GRD');
	var poly = ee.Geometry.Polygon(
	[[[-95.83648681640625, 29.561512529746743],
	[-95.042724609375, 29.57345707301757],
	[-95.02899169921875, 30.099989515377835],
	[-95.82275390625, 30.10711788709236]]]);
	var spatialFiltered = sentinel1.filter(ee.Filter.eq('instrumentMode', 'IW')).filterBounds(poly)
	.filter(ee.Filter.listContains('transmitterReceiverPolarisation', 'VV'))
	.select('VV');
	var image = spatialFiltered.filterDate('2017-08-25', '2017-09-05').mosaic().clip(poly);

	# For Windows users# Note: <> denotes changes to be made

	#Create a conda environment
	conda create --name <environment-name> python=<version:2.7/3.5>

	#To create a requirements.txt file:
	conda list #Gives you list of packages used for the environment

	conda list -e > requirements.txt #Save all the info about packages to your folder

	RN < 0.50 - watchman watch-del-all && rm -rf $TMPDIR/react-* && rm -rf node_modules/ && npm cache clean && npm install && npm start -- --reset-cache
	RN >= 0.50 - watchman watch-del-all && rm -rf $TMPDIR/react-native-packager-cache-* && rm -rf $TMPDIR/metro-bundler-cache-* && rm -rf node_modules/ && npm cache clean && npm install && npm start -- --reset-cache
	RN >= 0.63 - watchman watch-del-all && rm -rf node_modules && npm install && rm -rf /tmp/metro-* && npm run start --reset-cache

	npm >= 5 - watchman watch-del-all && rm -rf $TMPDIR/react-* && rm -rf node_modules/ && npm cache verify && npm install && npm start -- --reset-cache

	Windows - del %appdata%\Temp\react-native-* & cd android & gradlew clean & cd .. & del node_modules/ & npm cache clean --force & npm install & npm start -- --reset-cache

	#! /usr/bin/env python
	# -- coding: utf-8 --
	"""This module's docstring summary line.

	This is a multi-line docstring. Paragraphs are separated with blank lines.
	Lines conform to 79-column limit.

	Module and packages names should be short, lower_case_with_underscores.
	Notice that this in not PEP8-cheatsheet.py

	How to Completely Remove Android Studio


	Execute these commands from the terminal

	rm -Rf /Applications/Android\ Studio.app
	rm -Rf ~/Library/Preferences/AndroidStudio*
	rm ~/Library/Preferences/com.google.android.studio.plist
	rm -Rf ~/Library/Application\ Support/AndroidStudio*
	rm -Rf ~/Library/Logs/AndroidStudio*

	consumer_key = 'your-consumer-key'
	consumer_secret = 'your-consumer-secret'
	access_token = 'your-access-token'
	access_secret = 'your-access-secret'