Skip to content

Instantly share code, notes, and snippets.

@cjnolet
cjnolet / cuml-kmeans-mnmg-api.md
Last active October 11, 2024 10:54
Simple example of cuML's K-Means Single-GPU (SG) and Multi-Node Multi-GPU (MNMG) APIs compared to Scikit-learn and Dask-ML

Comparing cuML K-Means API Against Scikit-learn & Dask-ML

First, a quick code example of K-Means in Scikit-learn

from sklearn.datasets import make_blobs
from sklearn.cluster import KMeans

n_centers = 5

X, _ = make_blobs(n_samples=10000, n_centers=n_centers)
@songpon
songpon / ubuntu-install-dremio.sh
Created February 5, 2020 04:07
ubuntu 18.04 install dremio driver
wget https://download.dremio.com/odbc-driver/1.4.2.1003/dremio-odbc-1.4.2.1003-1.x86_64.rpm
sudo apt-get install alien unixodbc-dev -y
sudo alien dremio-odbc-1.4.2.1003-1.x86_64.rpm
sudo dpkg -i dremio-odbc_1.4.2.1003-2_amd64.deb
@willirath
willirath / SLURMCluster_vs_Singularity.ipynb
Last active December 8, 2024 16:08
Dask-Jobqueue SLURMCluster with Singularity
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@koolay
koolay / arrow_flight_dremio.py
Created July 28, 2020 04:01
demo of arrow-flight+dremio+vaex
from collections import namedtuple
import vaex
import time
import orjson
import os
import psutil
from pyarrow import flight
import pyarrow as pa
@tahashmi
tahashmi / arrow_flight_dremio.py
Last active February 9, 2023 20:36 — forked from koolay/arrow_flight_dremio.py
demo of arrow-flight+dremio+vaex
from collections import namedtuple
import vaex
import time
import orjson
import os
import psutil
from pyarrow import flight
import pyarrow as pa