Support for --initial_prompt feature?

[ankushg]

Thanks for this awesome resource!

The upstream whisper project added an --initial_prompt openai/whisper#128

Is there a way to use that with this model?

[steveturner]

Interested in this as well -- it looks like the TFWhisperForConditionalGeneration might need to be used.

I tried a few things but didn't see an obvious way to preload a tensor with the vocabulary/prompt and then parse the logits out when using Tensorflow. But I'm also a noob.

@nyadla-sys has some good discussion around the topic here huggingface/transformers#19691

[nyadla-sys]

@ankushg I have not looked into adding --initial_prompt for tflite whisper model as I am stuck in debugging full int8 model for whisper.
Hopefully i will give sometime next week on this