Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MI210] HIPIFY exllamaV2 succeeds on NV GPU and RX6700xt but fails on MI50 and MI210 #3339

Closed
deltaguo opened this issue Sep 27, 2023 · 0 comments
Closed

[MI210] HIPIFY exllamaV2 succeeds on NV GPU and RX6700xt but fails on MI50 and MI210 #3339

deltaguo opened this issue Sep 27, 2023 · 0 comments

Comments

@deltaguo
Copy link

deltaguo commented Sep 27, 2023 •
edited
Loading

There are some CUDA codes in exllamaV2, but it produces garbage when performing the text-generation task on MI210. Someone also encountered this issue on MI50, but it is correct when running on 6700xt and Nvidia GPU. I hope you can help locate the issue.

Here are the details.
@emankov emankov transferred this issue from ROCm/HIPIFY Sep 27, 2023
@emankov emankov changed the title HIPIFY exllamaV2 succeeds on NV GPU and RX6700xt but fails on MI50 and MI210 [MI210] HIPIFY exllamaV2 succeeds on NV GPU and RX6700xt but fails on MI50 and MI210 Sep 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@deltaguo