Ian Rose ian-r-rose
ian-r-rose
/ remove_bad_footprints.ipynb
Last active
December 6, 2023 22:16
Workflow demonstrating how to remove known bad footprints
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
ian-r-rose
/ footprints_with_parcels.ipynb
Last active
November 22, 2023 20:44
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
ian-r-rose
/ generate_key.sh
Created
November 1, 2023 15:38
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| set -euxo pipefail | |
| openssl genrsa 2048 | openssl pkcs8 -topk8 -v2 des3 -inform PEM -out $1.p8 -nocrypt | |
| openssl rsa -in $1.p8 -pubout -out $1.pub | |
| cat $1.p8 | |
| cat $1.pub |
ian-r-rose
/ generate_encrypted_key.sh
Created
October 31, 2023 23:11
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| set -euxo pipefail | |
| openssl genrsa 2048 | openssl pkcs8 -topk8 -v2 des3 -inform PEM -out $1.p8 -passout pass:"${2}" | |
| openssl rsa -in $1.p8 -pubout -out $1.pub -passin pass:"${2}" | |
| cat $1.p8 | |
| cat $1.pub |
ian-r-rose
/ pyarrow-string-slicing.ipynb
Last active
October 21, 2022 19:22
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
ian-r-rose
/ parquet-terabytes.py
Created
June 7, 2022 19:45
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import contextlib | |
| import time | |
| import coiled | |
| import dask | |
| import dask.dataframe as dd | |
| import distributed | |
| import pandas | |
| from dask.datasets import timeseries |
ian-r-rose
/ parquet-performance-2022.5.0.ipynb
Created
May 17, 2022 15:05
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
ian-r-rose
/ parquet-performance-2022.2.1.ipynb
Last active
May 17, 2022 15:03
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
ian-r-rose
/ read-parquet.ipynb
Last active
April 8, 2022 22:23
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
ian-r-rose
/ task-group-statistics-plugin.py
Created
April 8, 2022 18:39
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import datetime | |
| import distributed | |
| from distributed.diagnostics import SchedulerPlugin | |
| from distributed.utils import key_split, key_split_group | |
| class TaskGroupStatistics(SchedulerPlugin): | |
| def __init__(self): | |
| """Initialize the plugin""" |
NewerOlder