Shangeth shangeth
🏠
shangeth
/ download_common_voice_16.py
Created
March 6, 2024 02:27
This Python script automates downloading and extracting .tar files from the Common Voice dataset on Hugging Face, using a Hugging Face token for authorization. It creates directories based on set types (e.g., "test"), downloads specified .tar files, extracts their contents, and cleans up by removing the .tar files post-extraction. Ideal for res…
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import requests | |
| import os | |
| import tarfile | |
| # Hugging Face token | |
| hf_token = "<HF_TOKEN_HERE>" | |
| headers = {"Authorization": f"Bearer {hf_token}"} | |
| # Directory to save and extract files |
OlderNewer