Skip to content

Commit

Permalink
Update external benchmarks
Browse files Browse the repository at this point in the history
  • Loading branch information
iojw authored Jul 12, 2024
1 parent 1fdb680 commit 3a85b9e
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,8 @@ RouteLLM is a framework for serving and evaluating LLM routers.
Our core features include:

- Drop-in replacement for OpenAI's client (or launch an OpenAI-compatible server) to route simpler queries to cheaper models.
- Trained routers are provided out of the box, which we have shown to **reduce costs by up to 85%** while maintaining **95% GPT-4 performance** on widely-used benchmarks like MT Bench. Benchmarks also demonstrate that they achieve the same performance as commercial offerings while being >40% cheaper.
- Trained routers are provided out of the box, which we have shown to **reduce costs by up to 85%** while maintaining **95% GPT-4 performance** on widely-used benchmarks like MT Bench.
- Benchmarks also demonstrate that these routers achieve the same performance as commercial offerings while being **>40% cheaper**.
- Easily extend the framework to include new routers and compare the performance of routers across multiple benchmarks.

## Installation
Expand Down

0 comments on commit 3a85b9e

Please sign in to comment.