karpathy

LLM Wiki

A pattern for building personal knowledge bases using LLMs.

This is an idea file, it is designed to be copy pasted to your own LLM Agent (e.g. OpenAI Codex, Claude Code, OpenCode / Pi, or etc.). Its goal is to communicate the high level idea, but your agent will build out the specifics in collaboration with you.

The core idea

Most people's experience with LLMs and documents looks like RAG: you upload a collection of files, the LLM retrieves relevant chunks at query time, and generates an answer. This works, but the LLM is rediscovering knowledge from scratch on every question. There's no accumulation. Ask a subtle question that requires synthesizing five documents, and the LLM has to find and piece together the relevant fragments every time. Nothing is built up. NotebookLM, ChatGPT file uploads, and most RAG systems work this way.

geosmart

// Updated: Aug. 20, 2024
// Run: node testRegex.js whatever.txt
// Live demo: https://jina.ai/tokenizer
// LICENSE: Apache-2.0 (https://www.apache.org/licenses/LICENSE-2.0)
// COPYRIGHT: Jina AI
const fs = require('fs');
const util = require('util');

// Define variables for magic numbers
const MAX_HEADING_LENGTH = 7;

seanorama

PySpark on YARN in self-contained environments

Author: https://github.com/seanorama

Note: This was tested on HDP 3.1. It may not work with other Spark/YARN distributions.

Reference:

• https://community.cloudera.com/t5/Community-Articles/Using-VirtualEnv-with-PySpark/ta-p/245905
• https://community.cloudera.com/t5/Community-Articles/Running-PySpark-with-Conda-Env/ta-p/247551

hormesiel

import android.os.Build;

import java.lang.reflect.Method;

public class Device {
    /**
     * @return The device's serial number, visible to the user in {@code Settings > About phone/tablet/device > Status
     * > Serial number}, or {@code null} if the serial number couldn't be found
     */
    public static String getSerialNumber() {

garystafford

###############################################################################
# Helpful Docker commands and code snippets
###############################################################################

### CONTAINERS ###
docker stop $(docker ps -a -q) #stop ALL containers
docker rm -f $(docker ps -a -q) # remove ALL containers
docker rm -f $(sudo docker ps --before="container_id_here" -q) # can also filter

# exec into container

jsturgis

var mediaJSON = { "categories" : [ { "name" : "Movies",
        "videos" : [ 
		    { "description" : "Big Buck Bunny tells the story of a giant rabbit with a heart bigger than himself. When one sunny day three rodents rudely harass him, something snaps... and the rabbit ain't no bunny anymore! In the typical cartoon tradition he prepares the nasty rodents a comical revenge.\n\nLicensed under the Creative Commons Attribution license\nhttp://www.bigbuckbunny.org",
              "sources" : [ "http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/BigBuckBunny.mp4" ],
              "subtitle" : "By Blender Foundation",
              "thumb" : "images/BigBuckBunny.jpg",
              "title" : "Big Buck Bunny"
            },
            { "description" : "The first Blender Open Movie from 2006",
              "sources" : [ "http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/ElephantsDream.mp4" ],

geosmart

2013-05-01 11:04:36,466 [main] DEBUG [org.activiti.engine.impl.cfg.ProcessEngineConfigurationImpl] - database product name: 'Oracle'
2013-05-01 11:04:36,466 [main] DEBUG [org.activiti.engine.impl.cfg.ProcessEngineConfigurationImpl] - using database type: oracle
2013-05-01 11:04:37,596 [main] DEBUG [org.activiti.engine.impl.interceptor.LogInterceptor] -                                                                                                     
2013-05-01 11:04:37,597 [main] DEBUG [org.activiti.engine.impl.interceptor.LogInterceptor] - --- starting SchemaOperationsProcessEngineBuild --------------------------------------------------------
2013-05-01 11:04:37,805 [main] DEBUG [org.activiti.engine.impl.persistence.entity.PropertyEntity.selectProperty] - ooo Using Connection [Transaction-aware proxy for target Connection [org.hibernate.engine.jdbc.internal.proxy.ConnectionProxyHandler@7dfa50db[valid=true]]]
2013-05-01 11:04:37,810 [main] DEBUG [org.activiti.engine.impl.persistence.entity.PropertyEntity.se

geosmart

/**
   * 更改流程实例的流程定义ID
	 * @param processInstanceId
	 * @param processDefinitionId
	 */
	@Transactional
	public void changeProcessDefinitionId(String processInstanceId, String processDefinitionId) {
		long count = repositoryService.createProcessDefinitionQuery().processDefinitionId(processDefinitionId).count();
		if (count == 0) {
			throw new ServiceException("指定的流程定义不存在！");

seveniu

:%s/r//g                    删除DOS方式的回车^M 
:%s= *$==                   删除行尾空白 

:%s/^(.*)n1/1$/               删除重复行 

:%s/^.{-}pdf/new.pdf/         只是删除第一个pdf 

:%s/<!--_.{-}-->//           又是删除多行注释（咦？为什么要说「又」呢？） 

:g/s*^$/d                    删除所有空行 ：这个好用有没有人用过还有其他的方法吗？

geosmart

package com.famousPro.process.service.impl;

import java.util.ArrayList;
import java.util.HashMap;
import java.util.List;
import java.util.Map;

import org.activiti.engine.FormService;
import org.activiti.engine.HistoryService;
import org.activiti.engine.RepositoryService;