| layout | post |
|---|---|
| title | Decrease Memory Using Enums in Rust |
| published | true |
I am slowly building a sort of atom/universe generator/visualizer in Rust with friends. The project is called Oxidizy.
| #!/usr/bin/env bash | |
| # | |
| # llama-serve.sh — wrap llama-server with sane defaults for M3 Ultra | |
| # that approximate the LM Studio endpoint used by qwaude / SSH tunnel. | |
| # | |
| # Usage: | |
| # ./llama-serve.sh <path-to.gguf> | |
| # | |
| # Env overrides: | |
| # PORT (default 1234) |
| set -eou pipefail | |
| llama-bench \ | |
| -m ~/.models/Ministral-3-3B-Instruct-2512-Q4_K_M.gguf \ | |
| -m ~/.models/Ministral-3-8B-Instruct-2512-Q4_K_M.gguf \ | |
| -p 512 -n 128 -fa 1 -ngl 99 \ | |
| -d 0,4096,8192,16384 \ | |
| -o md > local-ministral-q4km-${MACHINE}.md 2>/dev/null |
| # wherever you have cloned the repo | |
| cd ~/Documents/Repos/llama.cpp | |
| # if you built relative to repo instead of user | |
| # build in $HOME/.local | |
| rm -rf build && cmake -B build \ | |
| -DGGML_CUDA=ON \ | |
| -DCMAKE_CUDA_ARCHITECTURES=86 \ | |
| -DBUILD_SHARED_LIBS=OFF \ | |
| -DCMAKE_INSTALL_PREFIX=$HOME/.local \ |
| # Apple Silicon llama-bench: Gemma 4 (E2B and E4B) Q4_K_M depth sweep | |
| # Testing for Gemma 4 (E2B and E4B) on Apple Silicon | |
| llama-bench \ | |
| -m ~/.lmstudio/models/lmstudio-community/gemma-4-E2B-it-GGUF/gemma-4-E2B-it-Q4_K_M.gguf \ | |
| -m ~/.lmstudio/models/lmstudio-community/gemma-4-E4B-it-GGUF/gemma-4-E4B-it-Q4_K_M.gguf \ | |
| -p 512 -n 128 -fa 1 -ngl 99 \ | |
| -d 0,4096,8192,16384 \ | |
| -o md > local-gemma-q4km-m5_max_36gb.md 2>/dev/null |
| # Apple Silicon and Linux x86 llama-bench: Ministral 3 family Q4_K_M depth sweep | |
| # Testing for the Ministral 3 family (Ministral-3B, Ministral-8B, Ministral-14B) on Apple Silicon | |
| # and (3B, 8B) on Ubuntu x86 with a 3060ti | |
| # Instruct only no reasoning | |
| llama-bench \ | |
| -m ~/.lmstudio/models/lmstudio-community/Ministral-3-3B-Instruct-2512-GGUF/Ministral-3-3B-Instruct-2512-Q4_K_M.gguf \ | |
| -m ~/.lmstudio/models/lmstudio-community/Ministral-3-8B-Instruct-2512-GGUF/Ministral-3-8B-Instruct-2512-Q4_K_M.gguf \ | |
| -m ~/.lmstudio/models/lmstudio-community/Ministral-3-14B-Instruct-2512-GGUF/Ministral-3-14B-Instruct-2512-Q4_K_M.gguf \ | |
| -p 512 -n 128 -fa 1 -ngl 99 \ |
| if [[ $PROJECT_DIR != "" ]]; then | |
| mkdir -p \ | |
| $PROJECT_DIR/models \ | |
| $PROJECT_DIR/textures \ | |
| $PROJECT_DIR/shaders \ | |
| $PROJECT_DIR/sounds \ | |
| $PROJECT_DIR/materials \ | |
| $PROJECT_DIR/scenes \ | |
| $PROJECT_DIR/addons \ | |
| $PROJECT_DIR/scripts \ |
| use rayon::prelude::*; | |
| const VEC_SIZE: usize = 1_000_000_001; | |
| const CHUNK_SIZE: usize = 128; | |
| enum FizzBuzz { | |
| FIFTEEN, | |
| THREE, | |
| FIVE, | |
| VALUE(u32), |
| layout | post |
|---|---|
| title | Decrease Memory Using Enums in Rust |
| published | true |
I am slowly building a sort of atom/universe generator/visualizer in Rust with friends. The project is called Oxidizy.
| sudo ls /var/crash | |
| sudo rm /var/crash/* | |
| sudo ls /var/crash |
I hereby claim:
To claim this, I am signing this object: