Skip to content

KoboldCPP-v1.63.yr1-ROCm
Compare
Choose a tag to compare
@github-actions github-actions released this 24 Apr 02:19
· 2188 commits to main since this release
v1.63.yr1-ROCm
f123ad3
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

TURN MMQ OFF

There was some big changes upstream, that's why it's taken a while to update kcpp-rocm, trying to get it to work.

This seems to work with MMQ DISABLED but I've also had reports of LLAMA3 not working with this version, but llama 3 8b instruct DID work for me

Assets 4
Loading