This is a release to further simplify TGI usage with Jetstream, making it the default backend, and correcting an environment variable usage. Finally, dependencies are updated to guarantee we use the latest features of the frameworks we are based on.
What's Changed
- fix(test): correct nightly tests with random sampling by @tengomucho in #117
- Jetstream by default by @tengomucho in #118
- 🧹 Cleanup of the batch size environment variables by @baptistecolle in #121
- ⬆️ Update dependencies by @tengomucho in #120
Full Changelog: v0.2.0...v0.2.1
Contributors
tengomucho and baptistecolle