KoboldCPP-v1.77.yr1-ROCm
·
343 commits
to main
since this release
- Bring Speed Back
upstream llama.cpp introduced a change to calculate certain values in full 32 bit precision by default which introduced a major slow down for some users with AMD GPUs, this reverts that change until improvements are made