v0.0.0beta28
·
164 commits
to main
since this release
What's Changed
- Tool completion respect num new tokens by @yunfeng-scale in #469
- Azure fixes + additional asks by @squeakymouse in #468
- Metrics for stuck async requests by @squeakymouse in #471
- Fix cacher by @yunfeng-scale in #472
- Add retries to deflake integration tests by @squeakymouse in #473
- add suffix to integration tests by @saiatmakuri in #474
- fix docs tests gateway endpoint by @saiatmakuri in #475
- Guided decoding by @yunfeng-scale in #476
Full Changelog: v0.0.0beta27...v0.0.0beta28
Contributors
squeakymouse, yunfeng-scale, and saiatmakuri