Skip to content

Instantly share code, notes, and snippets.

@josephrocca
josephrocca / count-pypi-packages-with-whl.js
Last active April 16, 2025 09:58
Count PyPI packages that currently include a downloadable .whl file
// Paste this in dev tools console at pypi.org to get the percentage of packages in the top 4000 (cccording to this list:https://hugovk.github.io/top-pypi-packages/) that have a downloadable .whl file.
// to get latest list:
//let topPythonPackages = await fetch("https://hugovk.github.io/top-pypi-packages/top-pypi-packages-365-days.min.json").then(r => r.json());
//topPythonPackages = topPythonPackages.rows.map(r => r.project);
// list from April 2021:
let topPythonPackages = ["urllib3","six","botocore","setuptools","requests","certifi","idna","python-dateutil","s3transfer","chardet","pyyaml","pip","boto3","docutils","jmespath","rsa","pyasn1","wheel","numpy","pytz","awscli","cffi","colorama","protobuf","markupsafe","jinja2","attrs","cryptography","pycparser","requests-oauthlib","oauthlib","importlib-metadata","zipp","pandas","click","pyparsing","packaging","pyasn1-modules","google-auth","cachetools","future","decorator","futures","google-api-core","jsonschema","scipy","pygments","werkzeug","pyrsistent","pil
@josephrocca
josephrocca / deno-github-readme-crawl.js
Last active April 22, 2021 14:10
Find the ratio of deno.land/x readmes (latest published versions) that are out of date with the default branch of the package's github repo
// Finds the ratio of deno.land/x readmes (latest published versions) that are out of date with the default branch of the package's github repo
// Run with:
// deno run --allow-net <raw-url-of-this-gist>
import { DOMParser } from "https://deno.land/x/deno_dom/deno-dom-wasm.ts";
let sameCount = 0;
let differentCount = 0;
let topDenoPackageNames = [];
for(let i = 1; i < 10; i++) {
@josephrocca
josephrocca / CLIP-speed-test-pt-vs-jax.ipynb
Last active September 10, 2021 11:25
Huggingface Flax vs. Pytorch CLIP speed test
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@josephrocca
josephrocca / BERT-speed-test-pt-vs-jax.ipynb
Created September 10, 2021 11:03
Huggingface Flax vs. Pytorch BERT speed test
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@josephrocca
josephrocca / JAX-jit-grad-f-pre-compile-test.ipynb
Last active September 10, 2021 12:42
JAX jit(grad(f)) pre-compile test
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@josephrocca
josephrocca / jax-bert-memory-test.ipynb
Last active September 11, 2021 03:53
9206d9832a4a8b46c66bc6cc99c14422
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@josephrocca
josephrocca / jax-clip-memory-test.ipynb
Last active September 11, 2021 05:05
JAX CLIP memory test
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@josephrocca
josephrocca / notebook.ipynb
Last active September 11, 2021 04:14
JAX low memory pre-allocation fraction test
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@josephrocca
josephrocca / flax-mem-leak.ipynb
Last active September 11, 2021 06:08
Flax memory leak (huggingface FlaxCLIPModel)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@josephrocca
josephrocca / jax-memory-leak-test--no-leak.ipynb
Last active September 11, 2021 07:06
JAX memory leak test (no leak)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.