Skip to content

Commit

Permalink
remove sentence-t5-xxl
Browse files Browse the repository at this point in the history
  • Loading branch information
BBC-Esq authored Jul 27, 2024
1 parent fdd3918 commit f87ba5c
Showing 1 changed file with 0 additions and 5 deletions.
5 changes: 0 additions & 5 deletions src/User_Manual/embedding_models.html
Original file line number Diff line number Diff line change
Expand Up @@ -181,11 +181,6 @@ <h2>Choosing the Correct Model</h2>

<p>...you would receive multiple sentences that mimic your query.</p>

<p>CAUTION: Currently, the <code>sentence-t5-xxl</code> model will not fit on any consumr GPU, even an RTX 4090.
You will be forced to terminate the program before it completes. Future patches will quantize this model to
make it barely fit on 24 GB of VRAM, but until then do not use it. The <code>sentence-t5-xl</code> will barely
fit on 24 GB of VRAM and should be used sparingly.</p>

<p>Overall, almost all of the generalist models selected for this program are good and you should only use the
<code>sentence-t5</code> models if you have a strong need for that specific task.</p>

Expand Down

0 comments on commit f87ba5c

Please sign in to comment.