Skip to content

Instantly share code, notes, and snippets.

View vincentsarago's full-sized avatar

Vincent Sarago vincentsarago

674 followers · 445 following
View GitHub Profile
@vincentsarago
vincentsarago / get_tile_resampling.py
Created September 20, 2019 02:04
"""test."""
import os
import sys
import click
import logging
import mercantile
import rasterio
@vincentsarago
vincentsarago / GOES16_to_COG.py
Created November 1, 2019 17:49
"""geos: netcdf_to_tiff."""
import os
import numpy
from netCDF4 import Dataset
from affine import Affine
@vincentsarago
vincentsarago / gist:b33eeca3c9b910bf1a4107db8551a20d
Created November 23, 2019 00:35
[{"where": "Canada", "tile": "9-115-123", "src_path": "https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_040013_20191014_20191029_01_T1_B4.tif", "bench": {"gdal": {"time": 1.1140458583831787, "get_number": 5, "data_transfer": 79920, "overview_level": "1", "warp_kernels": [["Src=1544,201,252x252", "Dst=0,0,256x256"]]}, "rio-tiler": {"time": 1.133565902709961, "get_number": 5, "data_transfer": 79920, "overview_level": "1", "warp_kernels": [["Src=1544,201,251x128", "Dst=0,0,256x128"], ["Src=1544,325,252x128", "Dst=0,128,256x128"]]}}}, {"where": "France", "tile": "9-255-179", "src_path": "https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_201027_20191022_20191030_01_T1_B4.tif", "bench": {"gdal": {"time": 1.0053620338439941, "get_number": 7, "data_transfer": 554896, "overview_level": "1", "warp_kernels": [["Src=1346,886,463x462", "Dst=0,0,256x256"]]}, "rio-tiler": {"time": 1.0662670135498047, "get_number": 7, "data_transfer": 554896, "overview_level": "1", "warp_kernels": [
@vincentsarago
vincentsarago / gdal2.4_results.json
Created November 23, 2019 00:35
[{"where": "Canada", "tile": "9-115-123", "src_path": "https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_040013_20191014_20191029_01_T1_B4.tif", "bench": {"gdal": {"time": 1.1140458583831787, "get_number": 5, "data_transfer": 79920, "overview_level": "1", "warp_kernels": [["Src=1544,201,252x252", "Dst=0,0,256x256"]]}, "rio-tiler": {"time": 1.133565902709961, "get_number": 5, "data_transfer": 79920, "overview_level": "1", "warp_kernels": [["Src=1544,201,251x128", "Dst=0,0,256x128"], ["Src=1544,325,252x128", "Dst=0,128,256x128"]]}}}, {"where": "France", "tile": "9-255-179", "src_path": "https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_201027_20191022_20191030_01_T1_B4.tif", "bench": {"gdal": {"time": 1.0053620338439941, "get_number": 7, "data_transfer": 554896, "overview_level": "1", "warp_kernels": [["Src=1346,886,463x462", "Dst=0,0,256x256"]]}, "rio-tiler": {"time": 1.0662670135498047, "get_number": 7, "data_transfer": 554896, "overview_level": "1", "warp_kernels": [
@vincentsarago
vincentsarago / gdal3.0_results.json
Created November 23, 2019 00:35
[{"where": "Canada", "tile": "9-115-123", "src_path": "https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_040013_20191014_20191029_01_T1_B4.tif", "bench": {"gdal": {"time": 1.5799047946929932, "get_number": 4, "data_transfer": 79921, "overview_level": "1", "warp_kernels": [["Src=1544,201,252x252", "Dst=0,0,256x256"]]}, "rio-tiler": {"time": 3.5712287425994873, "get_number": 4, "data_transfer": 98612, "overview_level": "1", "warp_kernels": [["Src=1544,201,251x128", "Dst=0,0,256x128"], ["Src=1544,325,252x128", "Dst=0,128,256x128"]]}}}, {"where": "France", "tile": "9-255-179", "src_path": "https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_201027_20191022_20191030_01_T1_B4.tif", "bench": {"gdal": {"time": 1.6891872882843018, "get_number": 6, "data_transfer": 554897, "overview_level": "1", "warp_kernels": [["Src=1346,886,463x462", "Dst=0,0,256x256"]]}, "rio-tiler": {"time": 3.466400146484375, "get_number": 6, "data_transfer": 554897, "overview_level": "1", "warp_kernels": [
@vincentsarago
vincentsarago / amazonlinux.md
Created November 28, 2019 20:21

Amazonlinux GDAL 3

timestamp delta log
17:26:43.314265 264ms HTTP: libcurl/7.61.1 OpenSSL/1.0.2k zlib/1.2.8 libidn2/0.16 libpsl/0.6.2 (+libicu/50.1.2) libssh2/1.4.2 nghttp2/1.21.1
17:26:43.578765 0ms VSICURL: GetFileSize(https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_040013_20191014_20191029_01_T1_B4.tif)=94908275  response_code=2
17:26:43.578910 73ms VSICURL: Downloading 0-16383 (https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_040013_20191014_20191029_01_T1_B4.tif)...
17:26:43.651596 0ms VSICURL: Got response_code=206
17:26:43.651905 0ms GDAL: GDALOpen(/vsicurl/https://s3.amazonaws.com/opendata.remotepixel.ca/bench_tiler/LC08_L1TP_040013_20191014_20191029_01_T1_B4.tif, this=0x1630860) succee
17:26:43.652130 0ms GDAL: GDALOpen(out.tif, this=0x1631ce0) succeeds as GTiff.
@vincentsarago
vincentsarago / cogeo-mosaic.py
Created December 3, 2019 20:46
import requests
import datetime
import urllib.parse
from concurrent import futures
from supermercado.burntiles import tile_extrema
endpoint = "https://landsatlive.live"
# Define AOI
@vincentsarago
vincentsarago / index.html
Created December 3, 2019 22:58
<!DOCTYPE html>
<html>
<head>
<meta charset='utf-8' />
<title>Mosaic Viewer</title>
<meta name='viewport' content='initial-scale=1,maximum-scale=1,user-scalable=no' />
<script src='https://api.tiles.mapbox.com/mapbox-gl-js/v1.0.0/mapbox-gl.js'></script>
<link href='https://api.tiles.mapbox.com/mapbox-gl-js/v1.0.0/mapbox-gl.css' rel='stylesheet' />
@vincentsarago
vincentsarago / c3.min.css
Created December 3, 2019 23:28
.c3 svg{font:10px sans-serif;-webkit-tap-highlight-color:transparent}.c3 line,.c3 path{fill:none;stroke:#000}.c3 text{-webkit-user-select:none;-moz-user-select:none;user-select:none}.c3-bars path,.c3-event-rect,.c3-legend-item-tile,.c3-xgrid-focus,.c3-ygrid{shape-rendering:crispEdges}.c3-chart-arc path{stroke:#fff}.c3-chart-arc rect{stroke:#fff;stroke-width:1}.c3-chart-arc text{fill:#fff;font-size:13px}.c3-grid line{stroke:#aaa}.c3-grid text{fill:#aaa}.c3-xgrid,.c3-ygrid{stroke-dasharray:3 3}.c3-text.c3-empty{fill:grey;font-size:2em}.c3-line{stroke-width:1px}.c3-circle{fill:currentColor}.c3-circle._expanded_{stroke-width:1px;stroke:#fff}.c3-selected-circle{fill:#fff;stroke-width:2px}.c3-bar{stroke-width:0}.c3-bar._expanded_{fill-opacity:1;fill-opacity:.75}.c3-target.c3-focused{opacity:1}.c3-target.c3-focused path.c3-line,.c3-target.c3-focused path.c3-step{stroke-width:2px}.c3-target.c3-defocused{opacity:.3!important}.c3-region{fill:#4682b4;fill-opacity:.1}.c3-region text{fill-opacity:1}.c3-brush .extent{fill-
@vincentsarago
vincentsarago / index.html
Created December 3, 2019 23:39
"""<!DOCTYPE html>
<html>
<head>
<meta charset='utf-8' />
<title>ABoVE: Landsat-derived Annual Dominant Land Cover Across ABoVE Core Domain, 1984-2014</title>
<meta name='viewport' content='initial-scale=1,maximum-scale=1,user-scalable=no' />
<script src='https://api.tiles.mapbox.com/mapbox-gl-js/v1.3.2/mapbox-gl.js'></script>
<link rel='stylesheet' href='https://api.tiles.mapbox.com/mapbox-gl-js/v1.3.2/mapbox-gl.css' type='text/css' />