Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rocWMMA support? #1132

Open
tedliosu opened this issue Oct 27, 2022 · 0 comments
Open

rocWMMA support? #1132

tedliosu opened this issue Oct 27, 2022 · 0 comments

Comments

@tedliosu
Copy link

🚀 The feature, motivation and pitch

Given how the competition has powerful pytorch extensions based on hardware-accelerated matrix FMA like tensorrt, and given how the impending gfx11 GPU releases have wmma support (similar to the competition's FMA-based tensorcores), I believe that it'd be really nice if pytorch-rocm is able to support GFX11's wmma instruction set (i.e. rocWMMA) via an extension similar to tensorrt or just natively via pytorch itself. Please refer to ROCm/tensorflow-upstream#1899 for the relevant issue I created for the tensorflow software stack counterpart.

Alternatives

Not really as I believe gfx 11 wmma support is the way to go moving forward :)

Additional context

N/A

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants