Skip to content

Commit

Permalink
Reference external benchmarks
Browse files Browse the repository at this point in the history
  • Loading branch information
iojw authored Jul 12, 2024
1 parent 73c897b commit 1fdb680
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ RouteLLM is a framework for serving and evaluating LLM routers.
Our core features include:

- Drop-in replacement for OpenAI's client (or launch an OpenAI-compatible server) to route simpler queries to cheaper models.
- Trained routers are provided out of the box, which we have shown to **reduce costs by up to 85%** on widely-used benchmarks such as MT Bench while maintaining **95% GPT-4 performance**.
- Trained routers are provided out of the box, which we have shown to **reduce costs by up to 85%** while maintaining **95% GPT-4 performance** on widely-used benchmarks like MT Bench. Benchmarks also demonstrate that they achieve the same performance as commercial offerings while being >40% cheaper.
- Easily extend the framework to include new routers and compare the performance of routers across multiple benchmarks.

## Installation
Expand Down

0 comments on commit 1fdb680

Please sign in to comment.