Skip to content

Instantly share code, notes, and snippets.

@dylanlee

dylanlee/EDFS-data-breakdown-and-docs.md

Last active July 30, 2026 15:47
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save dylanlee/149dbc240b572b96966157d38aa3c627 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save dylanlee/149dbc240b572b96966157d38aa3c627 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
EDFS-data-breakdown-and-docs.md

Icefabric tables

namespace current_snapshot_size_gb exportable_s3_size_gb
ak_hf 0.1743 0.1769
ak_nhf 0.4203 3.2987
ak_nhf_snapshots 0.0000 0.0000
bathymetry_ml_auxiliary 0.4482 0.4482
ble_xs 4.1737 4.1737
conus_hf 1.7313 2.3105
conus_nhf 3.3006 12.6501
conus_nhf_snapshots 0.0000 0.0000
conus_reference 1.9792 1.9792
divide_parameters 0.1594 0.1594
hi_hf 0.0215 0.0215
hi_nhf 0.0448 0.1326
hi_nhf_snapshots 0.0000 0.0000
hydrofabric_snapshots 0.0000 0.0000
icefabric_db 0.0000 0.0000
mip_xs 0.8638 0.8638
nhf 3.3006 12.6501
nhf_snapshots 0.0000 0.0000
parameter_metadata 0.0000 0.0001
prvi_hf 0.0106 0.0106
prvi_nhf 0.0408 0.1204
prvi_nhf_snapshots 0.0000 0.0000
ras_xs 8.3174 8.2286

Icechunk

  • 1.4 GB total size
  • Hourly streamflow observations for 1726 gages spanning from January 1, 1979 – December 31, 2025

Links

nhf-builds docs

Note: all paths are relative to repo root

  • README.md
  • docs/index.md
  • docs/input-data-sources.md
  • src/hydrofabric_builds/builds/README.md
  • tools/builds/glaciers/README.md
  • docs/builds/POI_gages_builder.md
  • docs/builds/divide_attributes.md
  • docs/builds/flowpath_attributes.md
  • docs/builds/index.md
  • docs/builds/irrigation.md
  • docs/builds/lakes.md
  • docs/builds/quickstart.md
  • docs/builds/reservoir_attrs.md
  • docs/builds/snap_gages_to_flowpaths.md

icefabric docs

  • README.md
  • data/README.md
  • docs/datasets/hydrofabric.md
  • docs/datasets/index.md
  • docs/datasets/ras_xs.md
  • docs/description.md
  • docs/index.md
  • docs/modules/cfe.md
  • docs/modules/index.md
  • docs/modules/lasam.md
  • docs/modules/lstm.md
  • docs/modules/noahowp.md
  • docs/modules/sacsma.md
  • docs/modules/sft.md
  • docs/modules/smp.md
  • docs/modules/snow17.md
  • docs/modules/topmodel.md
  • docs/modules/topoflow.md
  • docs/modules/troute.md
  • docs/modules/ueb.md
  • docs/user_guide/iceberg_table_build.md
  • docs/user_guide/icefabric_api.md
  • docs/user_guide/icefabric_tools.md
  • docs/user_guide/index.md
  • docs/user_guide/terraform.md
  • examples/icechunk_data_viewer/README.md
  • terraform/README.md
  • tools/iceberg/README.md
  • tools/iceberg/catalog_migration/README.md

NHF Builds Input Data Sources

Reference Hydrofabric and Flowpath Inputs

File name File size Description
reference_divides.parquet 1.2 GiB CONUS reference catchment polygons
reference_flowpaths.parquet 1.2 GiB CONUS reference stream network
ak_0.1.8_reference_divides.parquet 576.8 MiB Current Alaska reference divides
ak_0.1.8_reference_flowpaths.parquet 86.9 MiB Current Alaska reference flowpaths
hi_0.1.8_reference_divides.parquet 52.8 MiB Current Hawaii reference divides
hi_0.1.8_reference_flowpaths.parquet 9.1 MiB Current Hawaii reference flowpaths
prvi_0.1.8_reference_divides.parquet 47.9 MiB Current PRVI reference divides
prvi_0.1.8_reference_flowpaths.parquet 11.4 MiB Current PRVI reference flowpaths
nwm_flows.gpkg 1.8 GiB CONUS NWM flowpath crosswalk target
nwm_flows_alaska_nwmv3_ID_v2.gpkg 370.2 MiB Alaska NWM flowpath crosswalk target
NWM_v3_hydrofabric.gdb 4.7 GiB NWM version three hydrofabric geodatabase
TW_bf_predictions.parquet 21.2 MiB RiverML bankfull top-width predictions
Y_bf_predictions.parquet 21.2 MiB RiverML bankfull depth predictions
r_predictions.parquet 21.2 MiB RiverML hydraulic-radius predictions

Divide-Attribute Inputs

File name File size Description
nwm/*.tif 37.1 MiB total NWM soil and vegetation parameter grids
sac-sma/*.tif 3.7 GiB total Regional SAC-SMA parameter grids
ueb/*.tif 27.5 MiB total Monthly UEB temperature-delta grids
pet/*.tif 13.3 MiB total Potential evapotranspiration parameter grids
gw/*.tif 24.9 MiB total Groundwater storage parameter grids
gw/*.nc 5.0 GiB total Groundwater routing parameter datasets
snow17/*.tif 9.3 MiB total SNOW-17 model parameter grids
usgs/*.tif 2.0 GiB total Regional elevation slope aspect grids
twi*.tif 297.2 MiB total Regional topographic wetness grids
*_imperv_percent.tif 752.1 KiB total OCONUS impervious-surface percentage grids
glims_20250624.parquet 356.6 MiB GLIMS glacier coverage polygons
ak_nextgen.gpkg 234.3 MiB Alaska NextGen domain mask

Gage Inputs

File name File size Description
streamgages_*.kmz 927.4 KiB total State discontinued USGS streamgages
mv01dstx.shp … realstx.shp 30.5 MiB total Active USGS gage shapefiles
usgs_gages_all_conus_AK_Pr.gpkg 9.0 MiB Combined discontinued USGS gages
TXDOT_gages.txt 9.7 KiB Texas DOT streamgage locations
gage_xy_v1.1.csv 16.4 KiB Supplemental North American gage coordinates
gage_area.csv 292.5 KiB CIROH upstream gage drainage areas
nwm_calib_gages_07112025.csv 112.7 KiB NWM calibration gage inventory
RouteLink_CONUS_EPSG4326.gpkg 519.8 MiB CONUS NWM RouteLink gages
RouteLink_AK_EPSG4326.gpkg 77.3 MiB Alaska NWM RouteLink gages
RouteLink_HI_EPSG4326.gpkg 2.6 MiB Hawaii NWM RouteLink gages
RouteLink_PRVI_EPSG4326.gpkg 2.7 MiB PRVI NWM RouteLink gages
RouteLink_CONUS.nc 256.9 MiB Native CONUS RouteLink dataset
nwps_all_gauges_report.csv 5.1 MiB National Water Prediction Service gages
reservoir_index_AnA.nc 110.4 KiB CONUS RFC reservoir-gage crosswalk
reservoir_index_GDL_AK.nc 14.7 KiB Alaska RFC reservoir-gage crosswalk
calibratable_gages.csv 23.7 KiB Hydrofabric validation gage list
usbr.gpkg 292.0 KiB Bureau of Reclamation gage locations
override_gage_flowpaths.csv 114 B Manual gage-flowpath assignment overrides
CADWR.csv 610 B California water-resources gage identifiers
canada.gpkg 776.0 KiB Canadian maritime boundary polygons
lpr_000a21a_e.shp 4.1 MiB total Canadian maritime boundary shapefile
nldi_upstream_basins.gpkg 118.5 MiB Cached NLDI upstream gage basins

Lake and Reservoir Inputs

File name File size Description
nwm_lakes_sconus_input.gpkg 76.5 MiB SuperCONUS NWM lake polygons
nwm_lakes_sconus_input_500m_buffer.gpkg 34.0 MiB Buffered SuperCONUS lake polygons
nwm_lakes_hi_input.gpkg 140.0 KiB Hawaii NWM lake polygons
nwm_lakes_prvi_input.gpkg 416.0 KiB PRVI NWM lake polygons
ak_lakeparm.gpkg 148.0 KiB Alaska NWM lake parameter points
hi_nextgen_workaround.gpkg 29.9 MiB Hawaii HF 2.2 lake attributes
prvi_nextgen_workaround.gpkg 24.3 MiB PRVI HF 2.2 lake attributes
nwm_patch_conus_nextgen.gpkg 4.4 GiB CONUS HF 2.2 lake attributes
adhoc_lakes.gpkg 124.0 KiB Manually required lake locations
reference-reservoirs-v1.gpkg 19.0 MiB Curated reference reservoir points
reference_waterbodies.gpkg 386.5 MiB Reference waterbody polygons
NID2019_U.csv 26.1 MiB Archived National Inventory of Dams
NID_2025_11_02.csv 63.5 MiB Current dam inventory table
NID_2025_11_02.gpkg 75.0 MiB Current dam inventory geometries
COP90_DEM_SuperCONUS.tif 5.8 GiB SuperCONUS Copernicus elevation model
USGS_Seamless_DEM_13.vrt 743.6 KiB USGS seamless elevation virtual raster
osm_dams_all.gpkg 13.9 MiB Combined OpenStreetMap dam features
nwm_lakes.gpkg 77.2 MiB NWM lake and reservoir features
nwm_corrected.gpkg 152.0 KiB Manually corrected NWM lakes
LAKEPARM.parquet 367.3 KiB NWM lake hydraulic parameters
vpu03_lakes_input.gpkg 14.0 MiB VPU03 test lake polygons
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment