KoboldCPP-v1.66.1.yr0-ROCm
·
1778 commits
to main
since this release
https://github.com/LostRuins/koboldcpp/releases/tag/v1.66
Made FlashAttention on by default in Windows because it supposedly prevents the "access violation reading" error. Not sure if there are performance drawbacks, if so you can turn it off in the Hardware tab of the GUI
Full Changelog: v1.65.yr0-ROCm...v1.66.1.yr0-ROCm