Skip to content
Issue Notification

[Bug Report] Flash decode with GQA on Llama 3.1 8B shape does not work with (8,7) grid size #5798

Sign in to view logs

[Bug Report] Flash decode with GQA on Llama 3.1 8B shape does not work with (8,7) grid size

[Bug Report] Flash decode with GQA on Llama 3.1 8B shape does not work with (8,7) grid size #5798

Run time

Learn about OS pricing on GitHub Actions
Job Run time
gh-slack-bridge
3s
3s