Skip to content

Instantly share code, notes, and snippets.

@Helw150
Created May 19, 2026 01:23
Show Gist options
  • Select an option

  • Save Helw150/cfe8934d174b61589bcab225137021b3 to your computer and use it in GitHub Desktop.

Select an option

Save Helw150/cfe8934d174b61589bcab225137021b3 to your computer and use it in GitHub Desktop.
Marin storage report — 2026-05-19 01:23 UTC

GCS Storage Report

Generated: 2026-05-19T01:23:31Z

Overview

Metric Value
Total Objects 663.2M
Total Size 5,534.42 TB
Est. Monthly Cost $46,131
Annual Estimate $553,573

By Bucket

Bucket Region Objects Size (TB) Monthly Cost
marin-us-east5 US-EAST5 54.1M 1,788.73 $17,921
marin-us-central1 US-CENTRAL1 116.4M 1,706.87 $12,717
marin-us-central2 US-CENTRAL2 357.0M 1,373.88 $9,476
marin-eu-west4 EUROPE-WEST4 122.9M 430.47 $4,631
marin-us-west4 US-WEST4 2.4M 110.81 $920
marin-us-east1 US-EAST1 10.5M 123.65 $467

By Storage Class

Class Objects Size (TB) Monthly Cost % of Total
STANDARD 530.9M 2,069.84 $27,400 37.4%
NEARLINE 95.4M 2,485.79 $16,494 44.9%
COLDLINE 23.0M 761.22 $2,045 13.8%
ARCHIVE 13.9M 217.57 $193 3.9%

Top First-Level Directories

Bucket Directory Objects Size (TB) Monthly Cost
marin-us-east5 checkpoints/ 1.9M 825.21 $9,682
marin-us-central2 grug/ 779.0K 531.96 $4,414
marin-us-central1 checkpoints/ 3.6M 614.60 $3,838
marin-us-central2 checkpoints/ 54.8M 597.22 $3,374
marin-us-east5 grug/ 248.4K 247.81 $2,874
marin-us-central1 tokenized/ 3.4M 372.33 $2,323
marin-us-east5 tokenized/ 3.3M 337.01 $2,205
marin-us-east5 raw/ 1.9M 241.90 $1,957
marin-us-central1 normalized/ 843.0K 149.11 $1,944
marin-us-central1 raw/ 2.0M 205.04 $1,334
marin-eu-west4 datakit/ 80.0M 86.02 $1,290
marin-eu-west4 normalized/ 334.1K 66.00 $989
marin-us-central1 grug/ 96.5K 94.16 $923
marin-us-central1 data/ 646.6K 68.63 $895
marin-eu-west4 raw/ 775.0K 85.92 $869
marin-us-central2 raw/ 693.9K 111.71 $798
marin-eu-west4 tokenized/ 521.4K 96.21 $762
marin-us-central2 tokenized/ 1.2M 82.34 $582
marin-us-west4 raw/ 454.2K 59.57 $568
marin-us-central1 podcast_audio_top1000_60s_clips/ 84.3M 74.13 $483
marin-eu-west4 checkpoints/ 35.3M 72.56 $483
marin-us-west4 tokenized/ 397.3K 44.54 $306
marin-us-east5 julian/ 149.5K 18.39 $228
marin-us-east5 tmp/ 100.7K 17.18 $224
marin-us-east5 dmlab_256x256/ 229.6K 31.61 $206
marin-us-east1 raw/ 260.6K 55.47 $202
marin-us-central1 finetranslations-0d9d50/ 28.6K 27.90 $182
marin-us-east5 finetranslations-0d9d50/ 28.6K 27.90 $182
marin-us-central1 user/ 183.1K 13.67 $178
marin-us-east1 tokenized/ 623.9K 32.36 $139

Top Two-Level Prefixes

Bucket Prefix Objects Size (TB) Monthly Cost
marin-us-central2 checkpoints/isoflop 331.3K 234.12 $1,512
marin-us-east5 checkpoints/exp_sft_qwen3_32b_selfinstill_ot4_science26k_n8_vr5_2k_lr2e6_wd0-6a7611 35.8K 76.86 $1,002
marin-us-central1 data/datakit 646.4K 68.59 $894
marin-us-central1 normalized/nemotron_cc_v2 308.0K 65.78 $858
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume51000_clip15_20260504_014844-3cdab2 77.3K 43.41 $566
marin-us-east5 checkpoints/isoflop-curation 81.5K 42.97 $545
marin-us-east5 grug/chunked_perf 35.1K 40.87 $533
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_v5p32-05d8dc 58.8K 37.32 $487
marin-us-east5 tokenized/nemotron_cc 253.3K 67.13 $446
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_arch32k_v5p32-a26bea 50.4K 31.76 $414
marin-eu-west4 datakit/tokenize 98.5K 26.91 $404
marin-us-central1 tokenized/nemotron_cc_v2 377.4K 61.58 $401
marin-us-central1 normalized/nemotron_cc_v2_1 136.9K 29.90 $390
marin-us-east5 tokenized/merged 142.8K 40.19 $389
marin-eu-west4 normalized/nemotron_cc_v2 119.0K 25.53 $383
marin-us-east5 tokenized/nemotron_cc_v2 373.9K 58.66 $382
marin-us-central2 grug/moe-v7-1e22-d3200-5a4518 55.2K 54.03 $381
marin-us-central1 tokenized/nemotron_cc 152.0K 41.37 $378
marin-eu-west4 datakit/dedup 120.7K 24.83 $372
marin-us-east5 raw/dolma3_pool-d37843 957.5K 27.97 $365
marin-us-central2 tokenized/nemotron_cc 97.1K 27.15 $340
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume86437_clip15_20260512_142310-d2a994 39.0K 25.74 $336
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume93092_clip15_20260514_031402-5450e2 38.5K 24.80 $323
marin-us-central1 checkpoints/isoflop 894.2K 122.33 $320
marin-us-central1 checkpoints/isoflop-curation 34.1K 24.95 $319
marin-us-east5 grug/muonh_may_arch_1pct_lr_sweep 18.3K 23.93 $312
marin-us-central2 raw/nemotro-cc-eeb783 68.7K 23.55 $307
marin-eu-west4 datakit/store 78.9M 20.47 $307
marin-eu-west4 normalized/nemotron_v1 87.7K 18.51 $278
marin-us-central1 raw/nemotron_cc_v2-674913 37.0K 20.67 $269

Top 3-Level Prefixes

Bucket Prefix Objects Size (TB) Monthly Cost
marin-us-east5 checkpoints/exp_sft_qwen3_32b_selfinstill_ot4_science26k_n8_vr5_2k_lr2e6_wd0-6a7611/checkpoints 34.6K 72.61 $947
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume51000_clip15_20260504_014844-3cdab2/checkpoints 77.3K 43.41 $566
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_v5p32-05d8dc/checkpoints 58.7K 37.27 $486
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_arch32k_v5p32-a26bea/checkpoints 50.3K 31.71 $413
marin-us-east5 tokenized/merged/dolma3_dolmino_top_level 142.8K 40.19 $389
marin-us-central2 grug/moe-v7-1e22-d3200-5a4518/checkpoints 55.2K 54.03 $381
marin-eu-west4 datakit/dedup/dedup_v0_manual 120.7K 24.83 $372
marin-us-east5 raw/dolma3_pool-d37843/data 442.0K 27.97 $365
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume86437_clip15_20260512_142310-d2a994/checkpoints 39.0K 25.74 $336
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume93092_clip15_20260514_031402-5450e2/checkpoints 38.5K 24.80 $323
marin-us-central2 raw/nemotro-cc-eeb783/contrib 62.6K 23.55 $307
marin-us-central1 data/datakit/tokenized 492.3K 23.33 $304
marin-us-central1 data/datakit/normalized 55.6K 20.29 $265
marin-us-east5 julian/experiments/causal-diffusion 121.9K 18.04 $225
marin-us-east5 tmp/ttl=14d/checkpoints-temp 38.5K 17.17 $224
marin-us-east5 checkpoints/e3956np_m32b_q30ba3b_50k-efb0d2/checkpoints 9.0K 15.90 $207
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_fix_a2a_20260417_0945-d68919/checkpoints 25.3K 15.50 $202
marin-us-central2 raw/dclm/a3b142c 55.7K 14.39 $188
marin-us-central1 user/rav/full_dedup_exp1 183.1K 13.67 $178
marin-eu-west4 raw/nemotro-cc-eeb783/contrib 31.3K 11.77 $177
marin-us-central1 tokenized/finetranslations_parallel-929291/train 163.2K 26.65 $174
marin-us-east5 checkpoints/e3956np_m32b_kimi_50k-462e6f/checkpoints 7.5K 13.27 $173
marin-eu-west4 datakit/store/v0.1_20260518 49.9M 11.16 $167
marin-eu-west4 datakit/tokenize/nemotron_cc_v2 38.5K 10.96 $164
marin-us-central1 normalized/nemotron_cc_v2_1/medium_high_quality_synthetic_c1918ec6 57.1K 12.48 $163
marin-us-central1 normalized/nemotron_cc_v2_1/medium_high_quality_synthetic_e53eb9ed 57.1K 12.48 $163
marin-us-central1 normalized/nemotron_cc_v2/medium_quality_d2ead544 59.4K 12.14 $158
marin-us-central1 normalized/nemotron_cc_v2/medium_quality_4b3940a2 59.4K 12.14 $158
marin-us-central1 tokenized/nemotron_cc_v2_1/medium_high_quality_synthetic-237efe 179.3K 23.60 $154
marin-us-east1 raw/nemotro-cc-eeb783/contrib 62.6K 23.55 $154

Age Distribution

Age Objects Size (TB) Monthly Cost
<7d 88.5M 623.80 $8,410
7-30d 14.5M 1,140.37 $14,970
30-90d 106.5M 2,485.04 $17,427
90-365d 118.8M 841.02 $3,222
>365d 334.8M 444.20 $2,102

Monthly Creation Trend

Month Objects Created Size Created (TB)
2026-05 98.1M 1,114.69
2026-04 94.2M 1,607.76
2026-03 14.6M 1,194.82
2026-02 9.1M 499.75
2026-01 3.8M 269.57
2025-12 13.6M 95.41
2025-11 26.6M 30.35
2025-10 39.1M 40.57
2025-09 16.9M 23.26
2025-08 3.0M 88.46
2025-07 4.3M 104.79
2025-06 3.1M 16.37
2025-05 68.1M 41.20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment