Skip to content

1.1.3 - Optional Timings

Compare
Choose a tag to compare
@ActuallyTaylor ActuallyTaylor released this 28 Nov 17:32
· 5 commits to main since this release

Sometimes the Llama.cpp server will return values within timings as optional. This would cause the model to fail to decode. This has been fixed by just making them optional, so decoding still succeeds.