Skip to content

Instantly share code, notes, and snippets.

View TomNicholas's full-sized avatar

Tom Nicholas TomNicholas

View GitHub Profile
@TomNicholas
TomNicholas / coarsen.ipynb
Created January 26, 2023 06:18
Hero calculation via coarsening into regions
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / histogram_fight.ipynb
Last active February 8, 2023 18:33
Histogram comparison between flox and xhistogram
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / hero-calculation.py
Created February 11, 2023 19:42
Script to run full LLC4320 vorticity-strain-divergence histogram region on a LocalCluster
import xarray as xr
import dask
import xgcm
from typing import Annotated
from xhistogram.xarray import histogram
import numpy as np
@TomNicholas
TomNicholas / grid_ds_bug.ipynb
Last active March 13, 2023 18:10 — forked from shanicetbailey/Grid-bug
nb showing bug in xgcm Grid object
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / dask_demo.ipynb
Created March 16, 2023 16:08
xGCM and xhistogram calculation at dask demo day 16/03/2023
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / benchmark-quadratic.ipynb
Last active March 6, 2026 21:20
Cubed vs dask on various problematic pangeo workloads
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / cubed-quadratic.ipynb
Created May 8, 2023 16:01
Demo of using cubed on a pangeo-like problem
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / mem_plot_idea.ipynb
Created May 11, 2023 22:06
Cubed memory utilization plot ideas
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / from_array.ipynb
Created May 24, 2023 19:03
Cubed graphs created when creating xarray objects
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / era5-cubed.py
Created June 1, 2023 20:30
Bug with xarray lazy indexing and cubed
import sys
import yaml
import logging
from tqdm.contrib.logging import logging_redirect_tqdm
import xarray as xr
import cubed
from cubed.extensions.history import HistoryCallback