Skip to content

Instantly share code, notes, and snippets.

@naomi-henderson
Last active March 18, 2019 19:57
Show Gist options
  • Save naomi-henderson/c07386b76d47439c1c3d126a9849007e to your computer and use it in GitHub Desktop.
Save naomi-henderson/c07386b76d47439c1c3d126a9849007e to your computer and use it in GitHub Desktop.
The intake catalog for the sample CMIP6 3-hourly datasets
plugins:
source:
- module: intake_xarray
sources:
cmip6_3hr:
description: CMIP6 3-hourly precipitation, surface humidity and temperature data
metadata:
tags:
- atmosphere
- model
driver: zarr
args:
storage_options:
token: anon
access: read_only
consolidated: True
urlpath: 'gcs://pangeo-data/CMIP6-3hr'
plugins:
source:
- module: intake_xarray
sources:
CNRM_CM6_1.historical.r1i1p1f2.pr:
description: CMIP6 3-hourly precipitation for CNRM-CM6-1 historical scenario r1i1p1f2
metadata:
tags:
- atmosphere
- model
driver: zarr
args:
storage_options:
token: anon
access: read_only
consolidated: True
urlpath: 'gcs://pangeo-data/CMIP6_3hr/CNRM-CM6-1/historical/r1i1p1f2/pr/'
CNRM_CM6_1.historical.r1i1p1f2.tas:
description: CMIP6 3-hourly near surface temperature for CNRM-CM6-1 historical scenario r1i1p1f2
metadata:
tags:
- atmosphere
- model
driver: zarr
args:
storage_options:
token: anon
access: read_only
consolidated: True
urlpath: 'gcs://pangeo-data/CMIP6_3hr/CNRM-CM6-1/historical/r1i1p1f2/tas/'
CNRM_CM6_1.historical.r1i1p1f2.huss:
description: CMIP6 3-hourly near surface specific humidity for CNRM-CM6-1 historical scenario r1i1p1f2
metadata:
tags:
- atmosphere
- model
driver: zarr
args:
storage_options:
token: anon
access: read_only
consolidated: True
urlpath: 'gcs://pangeo-data/CMIP6_3hr/CNRM-CM6-1/historical/r1i1p1f2/huss/'
CNRM_CM6_1.historical.r2i1p1f2.pr:
description: CMIP6 3-hourly precipitation for CNRM-CM6-1 historical scenario r2i1p1f2
metadata:
tags:
- atmosphere
- model
driver: zarr
args:
storage_options:
token: anon
access: read_only
consolidated: True
urlpath: 'gcs://pangeo-data/CMIP6_3hr/CNRM-CM6-1/historical/r2i1p1f2/pr/'
CNRM_CM6_1.historical.r2i1p1f2.tas:
description: CMIP6 3-hourly near surface temperature for CNRM-CM6-1 historical scenario r2i1p1f2
metadata:
tags:
- atmosphere
- model
driver: zarr
args:
storage_options:
token: anon
access: read_only
consolidated: True
urlpath: 'gcs://pangeo-data/CMIP6_3hr/CNRM-CM6-1/historical/r2i1p1f2/tas/'
CNRM_CM6_1.historical.r2i1p1f2.huss:
description: CMIP6 3-hourly near surface specific humidity for CNRM-CM6-1 historical scenario r2i1p1f2
metadata:
tags:
- atmosphere
- model
driver: zarr
args:
storage_options:
token: anon
access: read_only
consolidated: True
urlpath: 'gcs://pangeo-data/CMIP6_3hr/CNRM-CM6-1/historical/r2i1p1f2/huss/'
@rabernat
Copy link

this does not look like it will work. You need one entry for each zarr dataset. The urlpath value will be passed directly to open zarr (via gcsfs if needed). There is no zarr group at the path /pangeo-data/CMIP6-3hr. I see three subdirs in that folder. There would need to be an intake entry for each, e.g. urlpath: gcs://pangeo-data/CMIP6-3hr/CNRM-CERFACS.CNRM-CM6-1.historical.3hr.gr/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment