add sdpa and flash_attention2 support to speech2text#33716

Open

avishaiElmakies wants to merge 12 commits intohuggingface:mainfrom avishaiElmakies:sdpa_speech2text

+367-17

Commits on Sep 25, 2024

start sdpa for speech to text
Avishai Elmakies
committed
add flash attention as well.
Avishai Elmakies
committed
add speech2text to docs
Avishai Elmakies
committed
move default tests to eager
Avishai Elmakies
committed
update encoder attention maks
Avishai Elmakies
committed

Commits on Sep 26, 2024

bug fix for when to expand embeddings in speech2text
Avishai Elmakies
committed
also fix the same bug in SpeechT5 beacuse of #Copied comment
Avishai Elmakies
committed
fixup
Avishai Elmakies
committed
[run-slow] speech2text
Avishai Elmakies
committed
add "test_flash_attn_2_generate_reuse_cache" inspired by whisper
Avishai Elmakies
committed
Merge branch 'main' into sdpa_speech2text
Avishai Elmakies
committed
[run-slow] speech2text
Avishai Elmakies
committed