Skip to content

Instantly share code, notes, and snippets.

@Helw150
Created May 19, 2026 05:04
Show Gist options
  • Select an option

  • Save Helw150/34d92dfda4e44af707d579eff711f28c to your computer and use it in GitHub Desktop.

Select an option

Save Helw150/34d92dfda4e44af707d579eff711f28c to your computer and use it in GitHub Desktop.
Marin storage report — 2026-05-19 05:04 UTC

GCS Storage Report

Generated: 2026-05-19T05:03:56Z

Overview

Metric Value
Total Objects 233.3M
Total Size 3,010.88 TB
Est. Monthly Cost $25,582
Annual Estimate $306,984

By Bucket

Bucket Region Objects Size (TB) Monthly Cost
marin-us-east5 US-EAST5 27.7M 899.01 $9,015
marin-us-central1 US-CENTRAL1 45.4M 843.53 $6,297
marin-us-central2 US-CENTRAL2 101.5M 682.55 $4,739
marin-eu-west4 EUROPE-WEST4 51.1M 413.16 $4,378
marin-us-west4 US-WEST4 2.4M 110.81 $920
marin-us-east1 US-EAST1 5.3M 61.82 $233

By Storage Class

Class Objects Size (TB) Monthly Cost % of Total
STANDARD 177.3M 1,143.79 $15,293 38.0%
NEARLINE 36.5M 1,345.98 $9,062 44.7%
COLDLINE 15.7M 403.92 $1,113 13.4%
ARCHIVE 3.8M 117.19 $114 3.9%

Top First-Level Directories

Bucket Directory Objects Size (TB) Monthly Cost
marin-us-east5 checkpoints/ 935.9K 414.02 $4,854
marin-us-central2 grug/ 391.0K 267.53 $2,227
marin-us-central1 checkpoints/ 1.8M 307.56 $1,922
marin-us-central2 checkpoints/ 27.4M 298.61 $1,687
marin-us-east5 grug/ 126.5K 127.02 $1,478
marin-us-central1 tokenized/ 1.7M 186.25 $1,161
marin-us-east5 tokenized/ 1.6M 168.62 $1,104
marin-eu-west4 datakit/ 8.9M 69.90 $1,048
marin-eu-west4 normalized/ 334.1K 66.00 $989
marin-us-east5 raw/ 963.0K 120.95 $979
marin-us-central1 normalized/ 422.1K 74.64 $973
marin-eu-west4 raw/ 846.0K 85.92 $869
marin-eu-west4 tokenized/ 519.4K 95.71 $758
marin-us-central1 raw/ 1.0M 102.52 $666
marin-us-west4 raw/ 454.2K 59.57 $568
marin-eu-west4 checkpoints/ 34.9M 72.15 $479
marin-us-central1 grug/ 48.2K 47.08 $461
marin-us-central1 data/ 323.3K 34.32 $447
marin-us-central2 raw/ 347.0K 55.86 $399
marin-us-west4 tokenized/ 397.3K 44.54 $306
marin-us-central2 tokenized/ 582.5K 41.17 $291
marin-us-central1 podcast_audio_top1000_60s_clips/ 30.0M 26.38 $172
marin-us-east5 julian/ 74.8K 9.19 $114
marin-us-east5 tmp/ 50.4K 8.55 $111
marin-us-east5 dmlab_256x256/ 114.8K 15.80 $103
marin-us-east1 raw/ 130.3K 27.73 $101
marin-us-central1 finetranslations-0d9d50/ 14.3K 13.95 $91
marin-us-east5 finetranslations-0d9d50/ 14.3K 13.95 $91
marin-us-central1 user/ 91.6K 6.84 $89
marin-us-east1 tokenized/ 311.9K 16.18 $70

Top Two-Level Prefixes

Bucket Prefix Objects Size (TB) Monthly Cost
marin-us-central2 checkpoints/isoflop 165.6K 117.06 $756
marin-us-east5 checkpoints/exp_sft_qwen3_32b_selfinstill_ot4_science26k_n8_vr5_2k_lr2e6_wd0-6a7611 17.9K 38.43 $501
marin-us-central1 data/datakit 323.2K 34.30 $447
marin-us-central1 normalized/nemotron_cc_v2 154.0K 32.89 $429
marin-eu-west4 datakit/tokenize 98.5K 26.91 $404
marin-eu-west4 normalized/nemotron_cc_v2 119.0K 25.53 $383
marin-eu-west4 datakit/dedup 120.7K 24.83 $372
marin-us-east5 grug/chunked_perf 18.9K 22.02 $287
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume51000_clip15_20260504_014844-3cdab2 38.6K 21.70 $283
marin-eu-west4 normalized/nemotron_v1 87.7K 18.51 $278
marin-us-east5 checkpoints/isoflop-curation 40.8K 21.50 $273
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_v5p32-05d8dc 29.4K 18.66 $243
marin-eu-west4 tokenized/dolma3_pool 105.9K 26.46 $231
marin-us-east5 tokenized/nemotron_cc 126.7K 33.56 $223
marin-eu-west4 tokenized/nemotron_cc 107.8K 28.62 $218
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_arch32k_v5p32-a26bea 25.2K 15.88 $207
marin-us-central1 tokenized/nemotron_cc_v2 188.7K 30.79 $201
marin-us-central1 normalized/nemotron_cc_v2_1 68.5K 14.95 $195
marin-us-east5 tokenized/merged 71.4K 20.09 $195
marin-us-east5 tokenized/nemotron_cc_v2 187.0K 29.33 $191
marin-us-central2 grug/moe-v7-1e22-d3200-5a4518 27.6K 27.02 $190
marin-us-central1 tokenized/nemotron_cc 76.0K 20.68 $189
marin-us-east5 raw/dolma3_pool-d37843 478.8K 13.98 $182
marin-eu-west4 raw/nemotro-cc-eeb783 62.6K 11.77 $177
marin-us-west4 tokenized/nemotron_cc 223.4K 25.86 $175
marin-us-central2 tokenized/nemotron_cc 48.5K 13.58 $170
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume86437_clip15_20260512_142310-d2a994 19.5K 12.87 $168
marin-us-central1 checkpoints/isoflop-curation 17.4K 12.73 $163
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume93092_clip15_20260514_031402-5450e2 19.2K 12.40 $162
marin-us-central1 checkpoints/isoflop 447.1K 61.16 $160

Top 3-Level Prefixes

Bucket Prefix Objects Size (TB) Monthly Cost
marin-us-east5 checkpoints/exp_sft_qwen3_32b_selfinstill_ot4_science26k_n8_vr5_2k_lr2e6_wd0-6a7611/checkpoints 17.3K 36.30 $473
marin-eu-west4 datakit/dedup/dedup_v0_manual 120.7K 24.83 $372
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume51000_clip15_20260504_014844-3cdab2/checkpoints 38.6K 21.70 $283
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_v5p32-05d8dc/checkpoints 29.4K 18.63 $243
marin-us-east5 checkpoints/exp5611_sft_qwen3_1_7b_swe_zero_1m_8192tokens_arch32k_v5p32-a26bea/checkpoints 25.1K 15.85 $207
marin-us-east5 tokenized/merged/dolma3_dolmino_top_level 71.4K 20.09 $195
marin-us-central2 grug/moe-v7-1e22-d3200-5a4518/checkpoints 27.6K 27.02 $190
marin-us-east5 raw/dolma3_pool-d37843/data 221.0K 13.98 $182
marin-eu-west4 raw/nemotro-cc-eeb783/contrib 31.3K 11.77 $177
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume86437_clip15_20260512_142310-d2a994/checkpoints 19.5K 12.87 $168
marin-eu-west4 datakit/tokenize/nemotron_cc_v2 38.5K 10.96 $164
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_resume93092_clip15_20260514_031402-5450e2/checkpoints 19.2K 12.40 $162
marin-us-central2 raw/nemotro-cc-eeb783/contrib 31.3K 11.77 $154
marin-us-central1 data/datakit/tokenized 246.1K 11.67 $152
marin-us-central1 data/datakit/normalized 27.8K 10.14 $132
marin-eu-west4 raw/dolma3_pool-d37843/data 221.0K 13.98 $119
marin-us-east5 julian/experiments/causal-diffusion 60.9K 9.02 $113
marin-us-east5 tmp/ttl=14d/checkpoints-temp 19.3K 8.54 $111
marin-us-east5 checkpoints/e3956np_m32b_q30ba3b_50k-efb0d2/checkpoints 4.5K 7.95 $104
marin-us-central2 grug/moe_1e23_d5120_bs2048_ep8_ragged_48l_fix_a2a_20260417_0945-d68919/checkpoints 12.6K 7.75 $101
marin-us-central2 raw/dclm/a3b142c 27.8K 7.20 $94
marin-eu-west4 normalized/nemotron_cc_v2_1/medium_high_quality_synthetic_c1918ec6 28.6K 6.24 $94
marin-eu-west4 normalized/nemotron_cc_v2/medium_quality_4b3940a2 29.7K 6.07 $91
marin-us-central1 user/rav/full_dedup_exp1 91.6K 6.84 $89
marin-us-central1 tokenized/finetranslations_parallel-929291/train 81.6K 13.33 $87
marin-us-east5 checkpoints/e3956np_m32b_kimi_50k-462e6f/checkpoints 3.7K 6.63 $86
marin-eu-west4 normalized/nemotron_v1/medium_725f15b4 27.7K 5.75 $86
marin-us-central1 normalized/nemotron_cc_v2_1/medium_high_quality_synthetic_c1918ec6 28.6K 6.24 $81
marin-us-central1 normalized/nemotron_cc_v2_1/medium_high_quality_synthetic_e53eb9ed 28.6K 6.24 $81
marin-us-central1 normalized/nemotron_cc_v2/medium_quality_d2ead544 29.7K 6.07 $79

Age Distribution

Age Objects Size (TB) Monthly Cost
<7d 13.2M 385.88 $5,276
7-30d 7.4M 596.26 $7,876
30-90d 42.2M 1,337.55 $9,547
90-365d 73.1M 448.48 $1,733
>365d 97.4M 242.71 $1,150

Monthly Creation Trend

Month Objects Created Size Created (TB)
2026-05 18.1M 634.82
2026-04 35.4M 833.26
2026-03 7.4M 630.36
2026-02 5.3M 305.23
2026-01 2.0M 144.53
2025-12 10.3M 56.03
2025-11 20.7M 19.75
2025-10 21.5M 20.87
2025-09 8.5M 11.63
2025-08 1.9M 45.28
2025-07 2.2M 52.40
2025-06 1.8M 11.81
2025-05 16.4M 26.54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment