Skip to content

Instantly share code, notes, and snippets.

#!/usr/bin/env bash
# The entry point of AWS Batch job. This script is in charge of configuring
# the repo, executing the given command, and uploading the results.
set -e
date
# Parse arguments
SOURCE_REF=$1
REPO=$2

HuggingFace Model Size

This table documents the top-5000 most download HuggingFace models (during 8/8/2022-9/8/2022) sorted by their sizes. Note that some models that are not Huggingface transformers compatible won't be listed here.

Model #Parameters
bigscience/bloom 176.2B
bigscience/bloom-petals 176.2B
facebook/opt-66b 65.7B
@comaniac
comaniac / hf_hub_model_size_db.json
Last active January 11, 2023 21:49
HF Model Size DB
{
"roberta-base": {
"model_id": "roberta-base",
"size": 0.124645632,
"code": 0,
"memo": null
},
"tals/albert-xlarge-vitaminc-mnli": {
"model_id": "tals/albert-xlarge-vitaminc-mnli",
"size": 0.058724864,
@comaniac
comaniac / hf_hub_download_trend_db.json
Last active December 18, 2023 00:11
HF Download Trend DB
This file has been truncated, but you can view the full file.
{
"09-14-22": [
{
"model_id": "bert-base-uncased",
"download": 31330425
},
{
"model_id": "Jean-Baptiste/camembert-ner",
"download": 20521361
},