Skip to content

Instantly share code, notes, and snippets.

@Helw150
Created May 19, 2026 02:55
Show Gist options
  • Select an option

  • Save Helw150/55e05b8897b3536bfe62461c13c015d7 to your computer and use it in GitHub Desktop.

Select an option

Save Helw150/55e05b8897b3536bfe62461c13c015d7 to your computer and use it in GitHub Desktop.
Marin storage report — 2026-05-19 02:55 UTC

GCS Storage Report

Generated: 2026-05-19T02:55:18Z

Overview

Metric Value
Total Objects 364.9M
Total Size 5,463.48 TB
Est. Monthly Cost $45,557
Annual Estimate $546,685

By Bucket

Bucket Region Objects Size (TB) Monthly Cost
marin-us-east5 US-EAST5 42.5M 1,781.97 $17,850
marin-us-central1 US-CENTRAL1 90.6M 1,672.35 $12,504
marin-us-central2 US-CENTRAL2 167.0M 1,360.34 $9,427
marin-eu-west4 EUROPE-WEST4 51.9M 414.37 $4,389
marin-us-west4 US-WEST4 2.4M 110.81 $920
marin-us-east1 US-EAST1 10.5M 123.64 $467

By Storage Class

Class Objects Size (TB) Monthly Cost % of Total
STANDARD 264.2M 2,048.49 $27,090 37.5%
NEARLINE 70.8M 2,446.81 $16,240 44.8%
COLDLINE 23.0M 760.29 $2,042 13.9%
ARCHIVE 7.0M 207.90 $185 3.8%

Top First-Level Directories

Bucket Directory Objects Size (TB) Monthly Cost
marin-us-east5 checkpoints/ 1.9M 827.43 $9,699
marin-us-central2 grug/ 776.3K 531.96 $4,414
marin-us-central1 checkpoints/ 3.6M 614.90 $3,842
marin-us-central2 checkpoints/ 52.0M 595.81 $3,365
marin-us-east5 grug/ 250.8K 251.59 $2,925
marin-us-central1 tokenized/ 3.2M 358.59 $2,240
marin-us-east5 tokenized/ 3.2M 332.64 $2,177
marin-us-central1 normalized/ 844.2K 149.28 $1,946
marin-us-east5 raw/ 1.8M 235.18 $1,870
marin-us-central1 raw/ 2.0M 205.04 $1,332
marin-eu-west4 datakit/ 9.1M 69.90 $1,048
marin-eu-west4 normalized/ 334.1K 66.00 $989
marin-us-central1 grug/ 96.5K 94.16 $923
marin-us-central1 data/ 646.6K 68.63 $895
marin-eu-west4 raw/ 846.0K 85.92 $869
marin-us-central2 raw/ 693.9K 111.71 $798
marin-eu-west4 tokenized/ 521.4K 96.21 $762
marin-us-central2 tokenized/ 1.2M 82.34 $582
marin-us-west4 raw/ 454.2K 59.57 $568
marin-eu-west4 checkpoints/ 35.3M 72.56 $482
marin-us-central1 podcast_audio_top1000_60s_clips/ 60.0M 52.76 $344
marin-us-west4 tokenized/ 397.3K 44.54 $306
marin-us-east5 julian/ 149.5K 18.39 $228
marin-us-east5 tmp/ 100.6K 16.94 $221
marin-us-east5 dmlab_256x256/ 229.6K 31.61 $206
marin-us-east1 raw/ 260.6K 55.47 $202
marin-us-central1 finetranslations-0d9d50/ 28.6K 27.90 $182
marin-us-east5 finetranslations-0d9d50/ 28.6K 27.90 $182
marin-us-central1 user/ 183.1K 13.67 $178
marin-us-east1 tokenized/ 623.9K 32.36 $139

Top Two-Level Prefixes

Bucket Prefix Objects Size (TB) Monthly Cost
marin-us-central2 checkpoints/isoflop 331.3K 234.12 $1,512
marin-us-east5 checkpoints/exp_sft_qwen3_32b_selfinstill_ot4_science26k_n8_vr5_2k_lr2e6_wd0-6a7611 35.8K 76.86 $1,002
marin-us-central1 data/datakit 646.4K 68.59 $894
marin-us-central1 normalized/nemotron_cc_v2 308.0K 65.78 $858
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume51000_clip15_20260504_014844-3cdab2 77.3K 43.41 $566
marin-us-east5 grug/chunked_perf 37.1K 43.25 $564
marin-us-east5 checkpoints/isoflop-curation 81.5K 42.97 $545
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_v5p32-05d8dc 58.8K 37.32 $487
marin-us-east5 tokenized/nemotron_cc 253.3K 67.13 $446
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_arch32k_v5p32-a26bea 50.4K 31.76 $414
marin-eu-west4 datakit/tokenize 98.5K 26.91 $404
marin-us-central1 tokenized/nemotron_cc_v2 377.4K 61.58 $401
marin-us-central1 normalized/nemotron_cc_v2_1 136.9K 29.90 $390
marin-us-east5 tokenized/merged 142.8K 40.19 $389
marin-eu-west4 normalized/nemotron_cc_v2 119.0K 25.53 $383
marin-us-east5 tokenized/nemotron_cc_v2 373.9K 58.66 $382
marin-us-central2 grug/moe-v7-1e22-d3200-5a4518 55.2K 54.03 $381
marin-us-central1 tokenized/nemotron_cc 152.0K 41.37 $378
marin-eu-west4 datakit/dedup 120.7K 24.83 $372
marin-us-central2 tokenized/nemotron_cc 97.1K 27.15 $340
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume86437_clip15_20260512_142310-d2a994 39.0K 25.74 $336
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume93092_clip15_20260514_031402-5450e2 38.5K 24.80 $323
marin-us-central1 checkpoints/isoflop-curation 34.6K 25.25 $323
marin-us-central1 checkpoints/isoflop 894.2K 122.33 $320
marin-us-east5 grug/muonh_may_arch_1pct_lr_sweep 18.3K 23.93 $312
marin-us-central2 raw/nemotro-cc-eeb783 68.7K 23.55 $307
marin-eu-west4 normalized/nemotron_v1 87.7K 18.51 $278
marin-us-east5 raw/dolma3_pool-d37843 843.8K 21.25 $277
marin-us-central1 raw/nemotron_cc_v2-674913 37.0K 20.67 $269
marin-us-east5 tokenized/dolma3_pool 239.8K 54.55 $253

Top 3-Level Prefixes

Bucket Prefix Objects Size (TB) Monthly Cost
marin-us-east5 checkpoints/exp_sft_qwen3_32b_selfinstill_ot4_science26k_n8_vr5_2k_lr2e6_wd0-6a7611/checkpoints 34.6K 72.61 $947
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume51000_clip15_20260504_014844-3cdab2/checkpoints 77.3K 43.41 $566
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_v5p32-05d8dc/checkpoints 58.7K 37.27 $486
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_arch32k_v5p32-a26bea/checkpoints 50.3K 31.71 $413
marin-us-east5 tokenized/merged/dolma3_dolmino_top_level 142.8K 40.19 $389
marin-us-central2 grug/moe-v7-1e22-d3200-5a4518/checkpoints 55.2K 54.03 $381
marin-eu-west4 datakit/dedup/dedup_v0_manual 120.7K 24.83 $372
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume86437_clip15_20260512_142310-d2a994/checkpoints 39.0K 25.74 $336
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume93092_clip15_20260514_031402-5450e2/checkpoints 38.5K 24.80 $323
marin-us-central2 raw/nemotro-cc-eeb783/contrib 62.6K 23.55 $307
marin-us-central1 data/datakit/tokenized 492.3K 23.33 $304
marin-us-east5 raw/dolma3_pool-d37843/data 328.2K 21.25 $277
marin-us-central1 data/datakit/normalized 55.6K 20.29 $265
marin-us-east5 julian/experiments/causal-diffusion 121.9K 18.04 $225
marin-us-east5 tmp/ttl=14d/checkpoints-temp 38.5K 16.93 $221
marin-us-east5 checkpoints/e3956np_m32b_q30ba3b_50k-efb0d2/checkpoints 9.0K 15.90 $207
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_fix_a2a_20260417_0945-d68919/checkpoints 25.3K 15.50 $202
marin-us-central2 raw/dclm/a3b142c 55.7K 14.39 $188
marin-us-central1 user/rav/full_dedup_exp1 183.1K 13.67 $178
marin-eu-west4 raw/nemotro-cc-eeb783/contrib 31.3K 11.77 $177
marin-us-east5 checkpoints/e3956np_m32b_kimi_50k-462e6f/checkpoints 7.5K 13.27 $173
marin-eu-west4 datakit/tokenize/nemotron_cc_v2 38.5K 10.96 $164
marin-us-central1 normalized/nemotron_cc_v2_1/medium_high_quality_synthetic_c1918ec6 57.1K 12.48 $163
marin-us-central1 normalized/nemotron_cc_v2_1/medium_high_quality_synthetic_e53eb9ed 57.1K 12.48 $163
marin-us-central1 normalized/nemotron_cc_v2/medium_quality_d2ead544 59.4K 12.14 $158
marin-us-central1 normalized/nemotron_cc_v2/medium_quality_4b3940a2 59.4K 12.14 $158
marin-us-central1 tokenized/nemotron_cc_v2_1/medium_high_quality_synthetic-237efe 179.3K 23.60 $154
marin-us-east1 raw/nemotro-cc-eeb783/contrib 62.6K 23.55 $154
marin-us-east5 checkpoints/e3956np_m32b_q4b_50k-bdafb6/checkpoints 6.6K 11.72 $153
marin-us-east5 checkpoints/e3956np_m32b_q30ba3b_10k_p2-fc5d93/checkpoints 6.2K 11.26 $147

Age Distribution

Age Objects Size (TB) Monthly Cost
<7d 17.4M 614.88 $8,263
7-30d 12.7M 1,137.36 $14,931
30-90d 80.3M 2,451.46 $17,206
90-365d 106.2M 832.04 $3,123
>365d 148.2M 427.74 $2,034

Monthly Creation Trend

Month Objects Created Size Created (TB)
2026-05 25.3M 1,104.81
2026-04 69.4M 1,585.79
2026-03 13.3M 1,181.36
2026-02 8.7M 492.96
2026-01 3.8M 269.42
2025-12 13.6M 94.65
2025-11 26.6M 30.22
2025-10 29.6M 40.44
2025-09 15.1M 22.94
2025-08 2.9M 88.46
2025-07 3.9M 103.93
2025-06 2.6M 16.36
2025-05 24.4M 40.57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment