You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It would seem like exllamav2 do sent work on device with a wave size of 64, the output is gibberish, i tested this on a MI25, MI50 and MI100 all of which are wave64 devices.
At the same time wave32 devices such as rx6800xt work fine.
exllama 1 works fine in all cases.
I tested this on ROCM 5.7 with pythoch 2.1
The text was updated successfully, but these errors were encountered:
It would seem like exllamav2 do sent work on device with a wave size of 64, the output is gibberish, i tested this on a MI25, MI50 and MI100 all of which are wave64 devices.
At the same time wave32 devices such as rx6800xt work fine.
exllama 1 works fine in all cases.
I tested this on ROCM 5.7 with pythoch 2.1
The text was updated successfully, but these errors were encountered: