Skip to content

Commit

Permalink
Deployed 02b3d6d to master with MkDocs 1.6.0 and mike 2.1.1
Browse files Browse the repository at this point in the history
  • Loading branch information
github-actions[bot] committed Jun 19, 2024
1 parent 7934180 commit 836ee47
Show file tree
Hide file tree
Showing 4 changed files with 175 additions and 175 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -1294,7 +1294,7 @@ <h3 id="openai-schema-integration">OpenAI Schema Integration<a class="headerlink
<p>This update fosters a standardized approach to transformer model serving, ensuring compatibility with a broader spectrum of models and tools, and enhances the platform's versatility. The API can be directly used with OpenAI's client libraries or third-party tools, like LangChain or LlamaIndex. </p>
<h3 id="future-plan">Future Plan<a class="headerlink" href="#future-plan" title="Permanent link"></a></h3>
<ul>
<li>Support other tasks like text embeddings <a href="https://github.com/kserve/kserve/issues/3572]">#3572</a></li>
<li>Support other tasks like text embeddings <a href="https://github.com/kserve/kserve/issues/3572">#3572</a>.</li>
<li>Support more LLM backend options in the future, such as TensorRT-LLM.</li>
<li>Enrich text generation metrics for Throughput(tokens/sec), TTFT(Time to first token) <a href="https://github.com/kserve/kserve/issues/3461">#3461</a>.</li>
<li>KEDA integration for token based LLM Autoscaling <a href="https://github.com/kserve/kserve/issues/3561">#3561</a>.</li>
Expand Down
2 changes: 1 addition & 1 deletion master/search/search_index.json

Large diffs are not rendered by default.

Loading

0 comments on commit 836ee47

Please sign in to comment.