twiecki
/ dask_sparse_corr.py
Created
August 17, 2018 11:26
Compute large, sparse correlation matrices in parallel using dask.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import dask | |
| import dask.array as da | |
| import dask.dataframe as dd | |
| import sparse | |
| @dask.delayed(pure=True) | |
| def corr_on_chunked(chunk1, chunk2, corr_thresh=0.9): | |
| return sparse.COO.from_numpy((np.dot(chunk1, chunk2.T) > corr_thresh)) | |
| def chunked_corr_sparse_dask(data, chunksize=5000, corr_thresh=0.9): |
ayhc
/ miyota9075.md
Last active
October 27, 2025 11:51
List of watches with the Miyota 9075 GMT movement
OlderNewer