Richard (Rick) Zamora rjzamora
rjzamora
/ read_file_list.ipynb
Created
October 30, 2020 20:02
Simple example of mapping multiple parquet files to each dask_cudf.DataFrame partition.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import os | |
| import shutil | |
| import time | |
| import numpy as np | |
| import dask.dataframe as dd | |
| from dask.dataframe.io.demo import names as name_list | |
| import fastavro as fa | |
| import cudf |
rjzamora
/ dask_pq_bench.py
Last active
December 1, 2020 20:15
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from dask.distributed import Client, LocalCluster, wait | |
| import dask.dataframe as dd | |
| from dask.datasets import timeseries | |
| import glob | |
| import time | |
| import argparse | |
| import numpy as np | |
| def run(args): |
rjzamora
/ nvtabular-dask-criteo-tutorial.ipynb
Last active
October 11, 2020 17:16
NVTabular-0.2-Dask-Blog-Tutorial
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
rjzamora
/ CPU_caching_experiment.ipynb
Created
April 25, 2020 16:46
Experiments for caching cudf DataFrame objects that will be re-read many times
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
rjzamora
/ tcp_merge_prof_4gpus.html
Created
January 27, 2020 16:47
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!DOCTYPE html> | |
| <html lang="en"> | |
| <head> | |
| <meta charset="utf-8"> |
rjzamora
/ tcp_set_index_prof_256tasks_4gpus.html
Created
January 27, 2020 16:39
This file has been truncated, but you can view the full file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!DOCTYPE html> | |
| <html lang="en"> | |
| <head> | |
| <meta charset="utf-8"> |
rjzamora
/ dask_cudf_merge_benchmark.ipynb
Last active
December 9, 2019 22:29
dask_cudf + UCX merge benchmark
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
rjzamora
/ Categorical_Debugging.ipynb
Created
September 25, 2019 14:15
Attempt to reproduce behavior described in cudf#2850 (instead reproduces behavior described in cudf#2862)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
rjzamora
/ Simple_percentile.ipynb
Created
September 5, 2019 23:16
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.