The Whisper JAX demo can be used as an endpoint through the Gradio Client library. The transcription API takes as input the audio file you want to transcribe, as well as optional arguments such as the task (transcribe or translate) and whether to return timestamps.

whisper_jax_endpoint.py

from gradio_client import Client


API_URL = "https://sanchit-gandhi-whisper-jax.hf.space/"

# set up the Gradio client
client = Client(API_URL)


def transcribe_audio(audio_path, task="transcribe", return_timestamps=False):
    """Function to transcribe an audio file using the Whisper JAX endpoint."""
    if task not in ["transcribe", "translate"]:
        raise ValueError("task should be one of 'transcribe' or 'translate'.")

    text, runtime = client.predict(
        audio_path,
        task,
        return_timestamps,
        api_name="/predict_1",
    )
    return text


# transcribe an audio file using the Whisper JAX endpoint
output = transcribe_audio("audio.mp3")

# transcribe and return timestamps
output_with_timestamps = transcribe_audio("audio.mp3", return_timestamps=True)

@sanchit-gandhi Any way to increase the timeout? The default seems to be 60 seconds.

The API_URL seems to only be forwarding gateway. And now the gateway is failing. Where was the service running on the other end?

https://sanchit-gandhi-whisper-jax.hf.space/ is just an nginx container to forward requests to the API_URL stored in the hugging face secret for the project.