Glavin001

Rust GPU Cheat Sheet

Scope: current community-owned Rust GPU mainline (rust-gpu), compiled to SPIR-V.
Audience: people writing real shaders and build pipelines, not just toy examples.
Goal: one clear reference for the parts you actually need: setup, crate structure, build flow, attributes, data layout, resources, images, advanced stages, debugging, testing, and the gotchas that matter on the current community version.

Read this first

Rust GPU is still a moving target. Treat it like a pinned toolchain snapshot, not a casually upgradable library stack.

• Keep all Rust-GPU crates on the exact same version/revision.

Glavin001

diff --git a/file.c b/file.c
index 6faa5a3..e3af329 100644
--- a/file.c
+++ b/file.c
@@ -1,26 +1,25 @@
 #include <stdio.h>
 
-// Frobs foo heartily
-int frobnitz(int foo)
+int fib(int n)

Glavin001

/* 
    Delta Compression by Glenn Fiedler. 
    This source code is placed in the public domain.
    http://gafferongames.com/2015/03/14/the-networked-physics-data-compression-challenge/
*/

#include <stdint.h>
#include <stdio.h>
#include <assert.h>
#include <string.h>

Glavin001

import base64
from io import BytesIO

from PIL import Image
import torch
import torch.nn as nn
import ollama
from diffusers import DiffusionPipeline, StableDiffusionPipeline
from safetensors.torch import load_file
from transformers import CLIPProcessor, CLIPModel, AutoImageProcessor, AutoModel

Glavin001

About

This is a demo of https://github.com/Glavin001/Data2AITextbook

Given a raw/unstructured input and produce high quality dataset for training an expert language model.

The following is an example demonstrating only a couple parts:

• Learning objective extraction with order/dependencies
• Lesson generation
• [TODO] Exercise generation

Glavin001

Usage

renderMermaid('graph TB\na-->b')

Output

graph TB

Glavin001

How to update CUDA version for TensorDock

Problem

TensorDock is pre-installed with CUDA 10.1 (old).

For many use-cases, such as Flash Attention 2 require newer versions of CUDA.

One symptom of this is nvcc and nvidia-smi will show different CUDA versions:

Glavin001

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts and experience preferred (super rare at this point).

My own notes from a few months back.

Background

• Survey of LLMS
• Self-attention and transformer networks

Glavin001

If you're using a high-end bluetooth headset on your Macbook Pro it's likely your mac is using an audio codec which favors battery efficiency over high quality. This results in a drastic degradation of sound, the SBC codec is the likely culprit, read more about it here.

Find out what codec you're using

1. Play a song on your headphones
2. Option (⌥) click the Bluetooth button at the top of your screen
3. If you're using AAC or aptX, you can stop here—those are the highest quality codecs.

Change your codec to AAC or aptX

Glavin001

{}