Skip to content

Instantly share code, notes, and snippets.

View sanchit-gandhi's full-sized avatar

Sanchit Gandhi sanchit-gandhi

765 followers · 0 following
View GitHub Profile
@sanchit-gandhi
sanchit-gandhi / whisper_jax_endpoint.py
Last active November 8, 2024 00:53
The Whisper JAX demo can be used as an endpoint through the Gradio Client library. The transcription API takes as input the audio file you want to transcribe, as well as optional arguments such as the task (transcribe or translate) and whether to return timestamps.
from gradio_client import Client
API_URL = "https://sanchit-gandhi-whisper-jax.hf.space/"
# set up the Gradio client
client = Client(API_URL)
def transcribe_audio(audio_path, task="transcribe", return_timestamps=False):
@sanchit-gandhi
sanchit-gandhi / README.md
Last active December 7, 2022 15:50
Proposal Whisper Announcement Post

Whisper in 🤗 Transformers

Whisper is available in the Hugging Face Transformers library from Version 4.23.1, with both PyTorch and TensorFlow implementations. All the official checkpoints can be found on the Hugging Face Hub, alongside documentation and examples scripts.

Fine-Tuning

Using the 🤗 Trainer, Whisper can be fine-tuned for speech recognition and speech translation tasks, boosting the performance of the model especially on low-resource languages. Refer to the blog post for a complete guide on fine-tuning Whisper. If you're interested in fine-tuning Whisper in your language, join us for our two-week [Whisper fine-tuning event](https://github.com/huggingface/community-events/tr