Tom Augspurger TomAugspurger
TomAugspurger
/ teams.sh
Last active
March 10, 2025 15:10
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env bash | |
| set -e | |
| PATH=/opt/homebrew/bin:$PATH | |
| # The exact UUID doesn't matter, but this should match what you select in the UI. | |
| UUID=edef356f-55b1-4132-b311-e5e8c10c6a33 | |
| # This path is MacOS specific. | |
| OUTPUT=$HOME/Library/Containers/com.microsoft.teams2/Data/Library/Application\ Support/Microsoft/MSTeams/Backgrounds/Uploads |
TomAugspurger
/ example.ipynb
Created
January 31, 2025 20:46
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
TomAugspurger
/ test_zarr.py
Created
January 31, 2025 20:39
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| dali + Zarr (GPU) example. | |
| This script adapts the GPU example from | |
| https://docs.nvidia.com/deeplearning/dali/user-guide/docs/examples/general/data_loading/external_input.html | |
| to use Zarr for storage. | |
| To run it, you'll currently need to use my fork of zarr-python: | |
| pip install git+https://github.com/TomAugspurger/zarr-python/@tom/fix/gpu |
TomAugspurger
/ gputest.py
Created
January 28, 2025 12:12
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Test reading (and writing) Zarr data with host and GPU. | |
| $ python gputest.py gpu read | |
| gpu read 2.96 | |
| $ python gputest.py cpu read | |
| cpu read 1.24 | |
| """ | |
| import argparse |
TomAugspurger
/ track.html
Created
May 28, 2024 14:49
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!DOCTYPE html> | |
| <html lang="en"> | |
| <head> | |
| <meta charset="utf-8" /> | |
| <meta http-equiv="X-UA-Compatible" content="IE=edge" /> | |
| <meta name="viewport" content="width=device-width, initial-scale=1" /> | |
| <title>memray - flamegraph report (memory leaks)</title> | |
| <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/[email protected]/dist/css/bootstrap.min.css"> |
TomAugspurger
/ goes-ice.ipynb
Created
November 27, 2023 18:23
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| S2A_MSIL2A_20210101T000751_R130_T48CWA_20210101T155441 | |
| S2A_MSIL2A_20210101T000751_R130_T48CWU_20210605T150149 | |
| S2A_MSIL2A_20210101T000751_R130_T50CMC_20210101T155143 | |
| S2A_MSIL2A_20210101T000751_R130_T49CDP_20210101T155258 | |
| S2A_MSIL2A_20210101T000751_R130_T49CDR_20210101T155234 | |
| S2A_MSIL2A_20210101T000751_R130_T49CES_20210101T155247 | |
| S2A_MSIL2A_20210101T000751_R130_T48CWV_20210101T155203 | |
| S2A_MSIL2A_20210101T000751_R130_T50CMB_20210606T092654 | |
| S2A_MSIL2A_20210101T000751_R130_T50CNT_20210101T154951 | |
| S2A_MSIL2A_20210101T000751_R130_T49CEP_20210101T155010 |
TomAugspurger
/ item_collection.json
Created
October 18, 2023 17:19
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
TomAugspurger
/ add_geoparquet.py
Created
June 6, 2023 02:00
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import dask.dataframe as dd | |
| import adlfs | |
| import geopandas | |
| import dask_geopandas | |
| import pyarrow.fs | |
| import pyproj | |
| import json | |
| import dask.distributed | |
| from typing import Dict, Any, Union, Optional |
TomAugspurger
/ delta-lake.ipynb
Created
May 1, 2023 14:33
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.