Hellisotherpeople

The Conspiracy Against High Temperature Sampling

Or: Why Your LLM Outputs Are Boring and Whose Fault It Really Is

---

There's a quiet war being waged in the machine learning inference space, and most of you don't even know you're losing it. Every day, millions of people interact with large language models through sanitized, corporatized interfaces that offer them a single "creativity" slider at best. Often they get nothing at all. Meanwhile, a small cabal of researchers and hobbyists has been pushing the boundaries of what's actually possible with modern sampling techniques. Yes, this includes the much maligned "coomer" community.

We live in a time of revealed conspiracies. The Epstein files have shown us what happens when powerful institutions coordinate to suppress information and protect their interests. Flight logs that sat in plain sight for years. Connections that "serious people" dismissed as paranoid speculation until the documents dropped. The pattern is always the same! Information asymme

nicowilliams

I recently happened upon a very interesting implementation of popen() (different API, same idea) called popen-noshell using clone(2), and so I opened an issue requesting use of vfork(2) or posix_spawn() for portability. It turns out that on Linux there's an important advantage to using clone(2). I think I should capture the things I wrote there in a better place. A gist, a blog, whatever.

This is not a paper. I assume reader familiarity with fork() in particular and Unix in general, though, of course, I link to relevant wiki pages, so if the unfamiliar reader is willing to go down the rabbit hole, they should be able to come ou