Skip to content

Instantly share code, notes, and snippets.

View SumukhP-dev's full-sized avatar

Sumukh Paspuleti SumukhP-dev

View GitHub Profile
@SumukhP-dev
SumukhP-dev / README.md
Last active October 13, 2025 10:18 — forked from JacobFV/README.md
huggingface_to_s3

Hugging Face Repository to S3 Transfer Script

This Python script allows you to transfer files from a Hugging Face repository to an Amazon S3 bucket. It iterates over all the files in the specified repository, downloads them one at a time, and uploads them to the designated S3 bucket.

Prerequisites

Before running the script, ensure that you have the following:

  • choose the aws linux ami with 10kIOPS and IO2 storage. make sure you can https out and ssh in