... to my blog style space for easier contribution by third parties and to provide what I believe to be an easier reading experience. Please field all enquiries and issues to the source repository.
Ben Messer benjaminmesser
Ralph-Fonz
/ openvpn_pia
Created
March 10, 2022 17:50
How to setup headless (No GUI/CLI Only) ubuntu openvpn pia
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Install OpenVPN | |
| # Now we install and configure OpenVPN, do the following commands: | |
| sudo apt-get install openvpn | |
| cd /etc/openvpn | |
| sudo wget https://www.privateinternetaccess.com/openvpn/openvpn.zip |
AbstractUmbra
/ 00-deprecation.md
Last active
June 14, 2025 18:43
discord.py 2.0+ slash command info and examples
ubergarm
/ DeepSeek-R1-Quantized-GGUF-Gaming-Rig-Inferencing-Fast-NVMe-SSD.md
Last active
July 10, 2025 15:03
Run DeepSeek R1 671B unsloth GGUF locally with ktransformers or llama.cpp on high end gaming rig!
UPDATE Mon Mar 10 10:51:31 AM EDT 2025 Check out the newer ktransformers guide for how to get it running faster! About 3.5 tok/sec on this same gaming rig. Big thanks to Supreeth Koundinya with analyticsindiamag.com for the article!
You can run the real deal big boi R1 671B locally off a fast NVMe SSD even without enough RAM+VRAM to hold the 212GB dynamically quantized weights. No it is not swap and won't kill your SSD's read/write cycle lifetime. No this is not a distill model. It works fairly well despite quantization (check the unsloth blog for details on how they did that).
The basic idea is that most of the model itself is not loaded into RAM on startup, but mmap'd. Then kv cache will take up some RAM. Most of your system RAM is left available to serve as disk cache for whatever experts/weights are currently most u