Skip to content

Instantly share code, notes, and snippets.

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
import dask.dataframe as dd
import adlfs
import geopandas
import dask_geopandas
import pyarrow.fs
import pyproj
import json
import dask.distributed
from typing import Dict, Any, Union, Optional
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
{
"count": 263463,
"keys": {
"type": {
"type": "distinct",
"count_with": 263463,
"count_without": 0,
"values": [
{
"type": "string",
/srv/conda/envs/notebook/lib/python3.10/site-packages/distributed/cli/dask_worker.py:264: FutureWarning: dask-worker is deprecated and will be removed in a future release use `dask worker` instead
warnings.warn(
2023-03-20 15:14:43,852 - distributed.nanny - INFO - Start Nanny at: 'tls://10.244.10.11:33815'
2023-03-20 15:14:46,216 - distributed.worker - INFO - Start worker at: tls://10.244.10.11:46721
2023-03-20 15:14:46,216 - distributed.worker - INFO - Listening to: tls://10.244.10.11:46721
2023-03-20 15:14:46,216 - distributed.worker - INFO - Worker name: dask-worker-351d74e2f7f644beb571a17408e81902-8z6lj
2023-03-20 15:14:46,216 - distributed.worker - INFO - dashboard at: 10.244.10.11:8787
2023-03-20 15:14:46,216 - distributed.worker - INFO - Waiting to connect to: tls://dask-351d74e2f7f644beb571a17408e81902.staging:8786
2023-03-20 15:14:46,216 - distributed.worker - INFO - -------------------------------------------------
2023-03-20 15:14:46,216 - d
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Driver: GTiff/GeoTIFF
Files: cog/S2A_MSIL2A_20221004T172201_N0400_R012_T18WVC_20221010T192849.SAFE/GRANULE/L2A_T18WVC_A038047_20221004T172155/IMG_DATA/R10m/T18WVC_20221004T172201_AOT_10m.tif
Size is 10980, 10980
Coordinate System is:
PROJCRS["WGS 84 / UTM zone 18N",
BASEGEOGCRS["WGS 84",
DATUM["World Geodetic System 1984",
ELLIPSOID["WGS 84",6378137,298.257223563,
LENGTHUNIT["metre",1]]],
PRIMEM["Greenwich",0,
$ gdal_translate -of zarr /vsicurl/https://naipeuwest.blob.core.windows.net/naip/v002/ia/2019/ia_60cm_2019/42091/m_4209150_sw_15_060_20190828.tif out.zarr
Input file size is 9833, 12777
0...10...20...30...40...50...60...70...80...90...100 - done.
$ gdalinfo out.zarr/
Driver: Zarr/Zarr
Files: out.zarr/
Size is 512, 512
Subdatasets:
SUBDATASET_1_NAME=ZARR:"out.zarr/":/X