Cedric Chee cedrickchee

Question

I am experienced backend programmer, very familiar with languages like Rust, Python, PHP and somewhat familiar with many others (did courses for bunch of stuff like scala, ruby, ocaml, sml, js, really a lot). Also I watch a bunch of youtube tutorials on stuff like game engine programming, reading r/programming and similar forums for a very long time.

Explain to me in detail how collision system works in UE 5.5, the data layout, optimizations, broadphase, narrowphase, which data is checked and how. Are actual numbers for positions i32 or what. I want really deep dive. Top-down overview that goes deeper later on.

FAQ on the xz-utils backdoor (CVE-2024-3094)

This is a living document. Everything in this document is made in good faith of being accurate, but like I just said; we don't yet know everything about what's going on.

Update: I've disabled comments as of 2025-01-26 to avoid everyone having notifications for something a year on if someone wants to suggest a correction. Folks are free to email to suggest corrections still, of course.

Background

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Pre-Transformer Models

ChatGPT Resources

Context

ChatGPT appeared like an explosion on all my social media timelines in early December 2022. While I keep up with machine learning as an industry, I wasn't focused so much on this particular corner, and all the screenshots seemed like they came out of nowhere. What was this model? How did the chat prompting work? What was the context of OpenAI doing this work and collecting my prompts for training data?

I decided to do a quick investigation. Here's all the information I've found so far. I'm aggregating and synthesizing it as I go, so it's currently changing pretty frequently.

Model Architecture

In the olden days, HTML was prepared by the server, and JavaScript was little more than a garnish, considered by some to have a soapy taste.

After a fashion, it was decided that sometimes our HTML is best rendered by JavaScript, running in a user's browser. While some would decry this new-found intimacy, the age of interactivity had begun.

But all was not right in the world. Somewhere along the way, we had slipped. Our pages went uncrawled by Bing, time to first meaningful paint grew faster than npm, and it became clear: something must be done.

And so it was decided that the applications first forged for the browser would also run on the server. We would render our HTML using the same logic on the server and the browser, and reap the advantages of both worlds. In a confusing series of events a name for this approach was agreed upon: Server-side rendering. What could go wrong?

In dark rooms, in hushed tones, we speak of colours.

List of AI Writing Tools 20230402 | by Rowe Morehouse @rowemore

in random order:

A half-hour to learn Zig

This is inspired by https://fasterthanli.me/blog/2020/a-half-hour-to-learn-rust/

Basics

the command zig run my_code.zig will compile and immediately run your Zig program. Each of these cells contains a zig program that you can try to run (some of them contain compile-time errors that you can comment out to play with)

	// Updated: Aug. 20, 2024
	// Run: node testRegex.js whatever.txt
	// Live demo: https://jina.ai/tokenizer
	// LICENSE: Apache-2.0 (https://www.apache.org/licenses/LICENSE-2.0)
	// COPYRIGHT: Jina AI
	const fs = require('fs');
	const util = require('util');

	// Define variables for magic numbers
	const MAX_HEADING_LENGTH = 7;

	# script to decompose/recompose llama model in different number of shards
	# note that it loads the full model * 2 in cpu memory

	import os
	import json
	import sys
	import torch
	import glob

	if len(sys.argv) != 4:

	I was drawn to programming, science, technology and science fiction
	ever since I was a little kid. I can't say it's because I wanted to
	make the world a better place. Not really. I was simply drawn to it
	because I was drawn to it. Writing programs was fun. Figuring out how
	nature works was fascinating. Science fiction felt like a grand
	adventure.

	Then I started a software company and poured every ounce of energy
	into it. It failed. That hurt, but that part is ok. I made a lot of
	mistakes and learned from them. This experience made me much, much