Base-model PPL vs post-RL math accuracy (issue #6096).
William Held Helw150
Helw150
/ build_static.py
Created
June 6, 2026 00:34
Static mixture explorer build script: rank-INT swarm targets, DSP per-task fits, Tristan's gamma, Pareto-improver, embedded JS gradient-slider mechanic
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """Build a single-file static HTML mixture explorer from the swarm CSVs. | |
| Output: docs/index.html (data inlined, Plotly via CDN). | |
| Open it directly with `file://` or serve with `python -m http.server -d docs/`. | |
| The docs/ folder is what GitHub Pages serves. | |
| Per-task fits use Calvin's DSP canonical form: | |
| e_p,d = c_p,d * w_p,d | |
| z_d = e_0,d + gamma * e_1,d | |
| y_hat(w) = -b0 + sum_d a_d (1 - exp(-rho_d z_d)) |
Helw150
/ marin-storage-report.md
Created
May 26, 2026 20:01
Marin storage report — 2026-05-26 20:01 UTC
Helw150
/ datakit_moe_mix_buckets_us_central2.csv
Created
May 25, 2026 22:32
datakit MoE mixture bucket sizes (us-central2 store_8ac06c74)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| bucket | tokens | epochs_for_8T | epochs_for_2T | |
|---|---|---|---|---|
| c01q0 | 152613773716 | 52.4199 | 13.105 | |
| c01q1 | 137672798475 | 58.1088 | 14.5272 | |
| c01q2 | 158419310113 | 50.4989 | 12.6247 | |
| c01q3 | 190944457285 | 41.897 | 10.4743 | |
| c01q4 | 516406017210 | 15.4917 | 3.8729 | |
| c02q0 | 17678211181 | 452.5345 | 113.1336 | |
| c02q1 | 22467740659 | 356.0661 | 89.0165 | |
| c02q2 | 54895261784 | 145.7321 | 36.433 | |
| c02q3 | 149886381691 | 53.3738 | 13.3434 |
Helw150
/ marin-storage-report.md
Created
May 23, 2026 00:30
Marin storage report — 2026-05-23 00:30 UTC
Helw150
/ marin-storage-report.md
Created
May 19, 2026 05:04
Marin storage report — 2026-05-19 05:04 UTC
Helw150
/ marin-storage-report.md
Created
May 19, 2026 03:52
Marin storage report — 2026-05-19 03:51 UTC
Helw150
/ marin-storage-report.md
Created
May 19, 2026 02:55
Marin storage report — 2026-05-19 02:55 UTC
Helw150
/ marin-storage-report.md
Created
May 19, 2026 01:23
Marin storage report — 2026-05-19 01:23 UTC
Helw150
/ grug_results_summary.json
Last active
May 13, 2026 20:25
Grug MoE data-mixture comparison (v0/v2/v3/v4) across compute scales — full lm-eval results across 17 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [ | |
| { | |
| "mix": "v0", | |
| "hidden_dim": 512, | |
| "budget": 2.19e+17, | |
| "tasks": { | |
| "mmlu_sl_verb_0shot": { | |
| "bpb,none": 0.844007877090332, | |
| "bpb_stderr,none": 0.004281199742552705, | |
| "acc_norm,none": 0.27332288847742486, |
NewerOlder