Skip to content

Pull requests: ROCm/flash-attention

New pull request New
11 Open 58 Closed
11 Open 58 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Support for Sliding Window Attention
#109 opened Dec 10, 2024 by alexkranias-amd Loading…
@micmelesse @alexkranias-amd
fp8 bwd
#108 opened Dec 9, 2024 by micmelesse • Draft
Clean Up
#107 opened Dec 6, 2024 by micmelesse • Draft
[Do not merge] vllm layout varlen WIP work in progress
#106 opened Dec 3, 2024 by rocking5566 Loading…
Added Benchmark for Rotary Decode Kernel + Performance Speed Up for Rotary Kernel
#102 opened Nov 22, 2024 by alexkranias-amd Loading…
@alexkranias-amd
Added Dropout BWD
#95 opened Nov 5, 2024 by alexkranias-amd Loading…
@alexkranias-amd
1
Fix stride issues in flash_attn_interface
#58 opened May 31, 2024 by clintg6 Loading…
1
@clintg6
GPUAI-1250 - Flash Attention v2.04 two modules layer_norm cannot be used fixed
#52 opened Apr 3, 2024 by xiaoxiangAMD Loading…
add FA api benchmark csv
#48 opened Mar 7, 2024 by fsx950223 Loading…
2
GPUAI-1250 - Flash Attention v2.04 module rotary cannot be used code fixed
#47 opened Mar 1, 2024 by xiaoxiangAMD Loading…
@sabreshao
2
Flash attention for rocm
#1 opened Feb 17, 2023 by groenenboomj Loading…
3
ProTip! Follow long discussions with comments:>50.