diff --git a/docs/reference/vllm.md b/docs/reference/vllm.md index 63be8ee29..567f0e0c8 100644 --- a/docs/reference/vllm.md +++ b/docs/reference/vllm.md @@ -12,7 +12,7 @@ You can then start the server with: python -m outlines.serve.serve --model="mistralai/Mistral-7B-Instruct-v0.2" ``` -This will by default start a server at `http://127.0.0.1:8000` (check what the console says, though) with the OPT-125M model. If you want to specify another model (e.g. Mistral-7B-Instruct-v0.2), you can do so with the `--model` parameter. +This will by default start a server at `http://127.0.0.1:8000` (check what the console says, though). Without the `--model` argument set, the OPT-125M model is used. The `--model` argument allows you to specify any model of your choosing. ### Alternative Method: Via Docker