Liam Clancy metafeather

🤗Huggingface Model Downloader

Note

(2025-01-08) Add feature for 🏷️Tag(Revision) Selection, contributed by @Bamboo-D.
(2024-12-17) Add feature for ⚡Quick Startup and ⏭️Fast Resume, enabling skipping of downloaded files, while removing the git clone dependency to accelerate file list retrieval.

Considering the lack of multi-threaded download support in the official huggingface-cli, and the inadequate error handling in hf_transfer, This command-line tool leverages curl and aria2c for fast and robust downloading of models and datasets.

Features

⏯️ Resume from breakpoint: You can re-run it or Ctrl+C anytime.

Running Cogmind as a self-contained app on macOS

Cogmind can be run as a self-contained app on macOS with the modern version of Wineskin Server.

If you are interested in only the performance mods skip to here.

Installing Wineskin

Installing Rosetta 2 (Apple Silicon only)

Wineskin requires the Rosetta 2 framework available from Apple for free. Open your terminal.app from Applications and run the following command to install it if not already present:

macOS Internals

Understand your Mac and iPhone more deeply by tracing the evolution of Mac OS X from prelease to Swift. John Siracusa delivers the details.

Starting Points

How to use this gist

You've got two main options:

(Scraped from the Internet Wayback Machine. Original content by Eran Hammer / hueniverse.com July 26, 2012)

OAuth 2.0 and the Road to Hell

They say the road to hell is paved with good intentions. Well, that’s OAuth 2.0.

Last month I reached the painful conclusion that I can no longer be associated with the OAuth 2.0 standard. I resigned my role as lead author and editor, withdraw my name from the specification, and left the working group. Removing my name from a document I have painstakingly labored over for three years and over two dozen drafts was not easy. Deciding to move on from an effort I have led for over five years was agonizing.

There wasn’t a single problem or incident I can point to in order to explain such an extreme move. This is a case of death by a thousand cuts, and as the work was winding down, I’ve found myself reflecting more and more on what we actually accomplished. At the end, I reached the conclusion that OAuth 2.0 is a bad

Merging git repositories, putting one of them into a subdirectory

For this you need git-filter-repo installed (filter-branch is discouraged).

cd a
git filter-repo --to-subdirectory-filter a

Remove All Subscriptions from a Specific Github Organization

This script will delete all the subscriptions in your account for the Github Organization passed to it.

This script was created when I took a new job, and my notification settings inadvertantly subscribed me to all 600+ of their repos. I wanted a better signal to noise ratio in my notifications, but I didn't want to click the "Unwatch All" button, which would remove my subscriptions to repos outside my new employer's org.

How To

Create a Personal Access Token with the "repo" scope, and expose it as the GITHUB_PERSONAL_ACCESS_TOKEN environment variable:

$ export GITHUB_PERSONAL_ACCESS_TOKEN=

	#EXTM3U
	#EXTINF:-1,BBC - Radio 1
	http://as-hls-ww-live.akamaized.net/pool_01505109/live/ww/bbc_radio_one/bbc_radio_one.isml/bbc_radio_one-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 1Xtra
	http://as-hls-ww-live.akamaized.net/pool_92079267/live/ww/bbc_1xtra/bbc_1xtra.isml/bbc_1xtra-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 1Dance
	http://as-hls-ww-live.akamaized.net/pool_62063831/live/ww/bbc_radio_one_dance/bbc_radio_one_dance.isml/bbc_radio_one_dance-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 1 Anthems (UK Only)
	http://as-hls-uk-live.akamaized.net/pool_904/live/uk/bbc_radio_one_anthems/bbc_radio_one_anthems.isml/bbc_radio_one_anthems-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 2

	import os
	import tempfile

	import apache_beam as beam
	import tensorflow as tf
	from tensorflow_data_validation.api import stats_api
	from tensorflow_data_validation.statistics import stats_options as options
	from tensorflow_data_validation.utils import stats_util
	import pyarrow as pa
	from tfx_bsl.arrow.array_util import ToSingletonListArray

	function usage() {
	echo "Usage: $0 [region] [cluster name] [role arn]"
	echo "If you're not using a role, [region] and [role arn] are optional"
	echo "If you just use cluster name, you need aws-iam-authenticator installed"
	}

	if [ -z $1 ]; then
	usage
	exit 1
	fi

	...

	{{- partial "toc.html" . -}}

	...