·
119 commits
to main
since this release
What's Changed
- Hardcode llama 3 70b endpoint param by @yunfeng-scale in #524
- Don't fail checking GPU memory by @yunfeng-scale in #525
- Option to read Redis URL from AWS Secret by @seanshi-scale in #526
- Fix formatting on completions documentation guide by @saiatmakuri in #527
- Higher priority for gateway by @yunfeng-scale in #529
- Non-interactive installation during docker build by @yunfeng-scale in #533
- [Client] Add guided_grammar and other missing fields by @seanshi-scale in #532
Full Changelog: v0.0.0beta33...v0.0.0beta34
Contributors
seanshi-scale, yunfeng-scale, and saiatmakuri