Skip to content

v6.6.0 - 8192 CONTEXT!
Compare
Choose a tag to compare
@BBC-Esq BBC-Esq released this 12 Aug 01:06
· 324 commits to main since this release
v6.6.0
c9c4774
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

General Updates

  • Ensured that vector model pulldown menu auto-updates.
  • Made the vector model pulldown menu more descriptive.

Local Models

  • Added Internlm v 2.5 1.8b. In the last release, version 2.0 of Internlm's 1.8b model was removed. However, the quality increased noticeably with their version 2.5 so I'm re-adding it.

Vector Models

  • Excited to add Alibaba-NLP/gte-base-en-v1.5 and Alibaba-NLP/gte-large-en-v1.5. These vector models have a context limit of 8192, which is automatically set within the program. With a conservative estimate of 3 characters per token, that means that you can set the chunk size to approximatly 24,576!!
  • Removed Stella as it was under-performing and too difficult to work with. There is no love loss since the prior release marked it as "experimental" anyways.

Current Chat and Vision Models

chart_chat chart_vision
Assets 2
Loading