- all runs below use
LocalDirectRunner
- all runs below should attempt to run in under 60 minutes so we don't hit token expiry (only for EDL https/s3 auth)
- when we say cached
"disabled"
we mean you never setc.InputCacheStorage.fsspec_class
in your config
https://github.com/ranchodeluxe/staged-recipes/tree/gpm_zarr_failcase
Source | s3://gesdisc-cumulus-prod-protected | s3://gesdisc-cumulus-prod-protected | s3://gesdisc-cumulus-prod-protected |
---|---|---|---|
Auth Mode | temp token | temp token | temp token |
Cache Type | disabled | local | s3 |
Job Behavior | hangs | completes | hangs |
https://github.com/ranchodeluxe/staged-recipes/tree/gpm_zarr_failcase_assumerole
Source | s3://gesdisc-cumulus-prod-protected | s3://gesdisc-cumulus-prod-protected | s3://gesdisc-cumulus-prod-protected |
---|---|---|---|
Auth Mode | assume role | assume role | assume role |
Cache Type | disabled | local | s3 |
Job Behavior | completes | completes | completes |
https://github.com/ranchodeluxe/staged-recipes/tree/gpm_zarr_nofailcase
Source | s3://pangeo-forge-uah-test-output | s3://pangeo-forge-uah-test-output | s3://pangeo-forge-uah-test-output |
---|---|---|---|
Auth Mode | public bucket | public bucket | public bucket |
Cache Type | disabled | local | s3 |
Job Behavior | completes | completes | completes |