Kyle Barron kylebarron
👨💻
kylebarron
/ parquet_metadata_exploration.py
Created
February 25, 2022 20:14
Explore partitioning geometries into arrow row groups with bbox metadata info
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import json | |
| import pyarrow as pa | |
| import pyarrow.parquet as pq | |
| import pandas as pd | |
| import numpy as np | |
| def main(): | |
| # Create random point data within bbox | |
| size = 1_000_000 |
kylebarron
/ osm-liberty.json
Created
February 7, 2022 18:41
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "version": 8, | |
| "name": "OSM Liberty", | |
| "metadata": { | |
| "maputnik:license": "https://github.com/nst-guide/osm-liberty-topo/blob/gh-pages/LICENSE.md", | |
| "maputnik:renderer": "mbgljs" | |
| }, | |
| "sources": { | |
| "openmaptiles": { | |
| "type": "vector", |
kylebarron
/ pydantic.py
Created
October 4, 2021 17:30
— forked from danielhfrank/pydantic.py
Pydantic with Numpy
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from typing import Generic, TypeVar | |
| import numpy as np | |
| from pydantic.fields import ModelField | |
| JSON_ENCODERS = { | |
| np.ndarray: lambda arr: arr.tolist() | |
| } | |
| DType = TypeVar('DType') |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import requests | |
| import re | |
| # Airport ninja | |
| # product_id = '163194625' | |
| # n_pages = 63 | |
| # B2 | |
| product_id = '3776320176181' | |
| n_pages = 17 |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
kylebarron
/ sentinel-2-l2a-mosaic-120-2019-12-7-01K.json
Last active
February 10, 2021 06:49
Scratch work for creating STAC items for Sentinel-2 L2A 120m Mosaic (https://registry.opendata.aws/sentinel-s2-l2a-mosaic-120/)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "type": "Feature", | |
| "stac_version": "1.0.0-beta.2", | |
| "id": "sentinel-2-l2a-mosaic-120-2019-12-7-01K", | |
| "properties": { | |
| "start_datetime": "2019-12-07T00:00:00", | |
| "end_datetime": "2019-12-17T00:00:00", | |
| "platform": "sentinel-2", | |
| "gsd": 120, | |
| "datetime": null |
kylebarron
/ pyproject.toml
Created
November 4, 2020 19:49
Example pyproject.toml for poetry issue "BadZipFile with public pypi package"
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [tool.poetry] | |
| name = "tmp" | |
| version = "0.1.0" | |
| description = "" | |
| authors = ["Kyle Barron"] | |
| [tool.poetry.dependencies] | |
| python = "^3.7" | |
| pyarrow = "^2.0.0" |
kylebarron
/ pack-12bits-sentinel.py
Created
September 15, 2020 00:45
Example of packing bits for sentinel data
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import zlib | |
| from io import BytesIO | |
| # pip install bitstruct | |
| import bitstruct | |
| import numpy as np | |
| import rasterio | |
| path = 's3://sentinel-cogs/sentinel-s2-l2a-cogs/2020/S2A_26PQB_20200401_0_L2A/B02.tif' |
kylebarron
/ pack-12bits.py
Created
September 14, 2020 23:48
Pack 12-bit buffer (very inefficient right now)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import zlib | |
| from io import BytesIO | |
| # pip install bitstruct | |
| import bitstruct | |
| import numpy as np | |
| arr = np.random.randint(0, 4096, size=(256, 256), dtype=np.uint16) | |
| buf = BytesIO() | |
| np.save(buf, arr) |
kylebarron
/ widget-deserialization.ipynb
Created
April 23, 2020 22:59
— forked from pbugnion/widget-deserialization.ipynb
Deserializing sub-widgets with ipywidgets (originally from https://stackoverflow.com/questions/56477875/child-widget-creation-in-ipywidgets-produces-an-error-using-viewlist-and-create/56537296#56537296)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.