Skip to content

Commit

Permalink
nit
Browse files Browse the repository at this point in the history
  • Loading branch information
cathyzbn committed Aug 19, 2024
1 parent 175321c commit b8e398d
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions 06_gpu_and_ml/openai_whisper/batched_whisper.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@
#
# In this example, we demonstrate how to run [dynamically batched inference](https://modal.com/docs/guide/dynamic-batching)
# for OpenAI's speech recognition model, [Whisper](https://openai.com/index/whisper/), on Modal.
# Batching multiple audio samples together or batching chunks of a single audio sample can help to achieve a 2.5x increase
# in inference throughput on an A100!
# Batching multiple audio samples together or batching chunks of a single audio sample can help to achieve a 2.8x increase
# in inference throughput on an A10G!
#
# We will be running the [Whisper Large V3](https://huggingface.co/openai/whisper-large-v3) model.
# To run [any of the other HuggingFace Whisper models](https://huggingface.co/models?search=openai/whisper),
Expand Down

0 comments on commit b8e398d

Please sign in to comment.