Skip to content

Commit

Permalink
Update the documentation with installation instructions
Browse files Browse the repository at this point in the history
  • Loading branch information
rlouf committed Nov 28, 2024
1 parent 1a7bff8 commit b504ad3
Show file tree
Hide file tree
Showing 5 changed files with 22 additions and 6 deletions.
6 changes: 5 additions & 1 deletion docs/reference/models/llamacpp.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,11 @@ Outlines provides an integration with [Llama.cpp](https://github.com/ggerganov/l

!!! Note "Installation"

You need to install the `llama-cpp-python` library to use the llama.cpp integration. See the [installation section](#installation) for instructions to install `llama-cpp-python` with CUDA, Metal, ROCm and other backends.
You need to install the `llama-cpp-python` library to use the llama.cpp integration. See the [installation section](#installation) for instructions to install `llama-cpp-python` with CUDA, Metal, ROCm and other backends. To get started quickly you can also run:

```bash
pip install "outlines[llamacpp]"
```

## Load the model

Expand Down
6 changes: 5 additions & 1 deletion docs/reference/models/mlxlm.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,11 @@ Outlines provides an integration with [mlx-lm](https://github.com/ml-explore/mlx

!!! Note "Installation"

You need to install the `mlx` and `mlx-lm` libraries on a device which [supports Metal](https://support.apple.com/en-us/102894) to use the mlx-lm integration.
You need to install the `mlx` and `mlx-lm` libraries on a device which [supports Metal](https://support.apple.com/en-us/102894) to use the mlx-lm integration. To get started quickly you can also run:

```bash
pip install "outlines[mlxlm]"
```


## Load the model
Expand Down
6 changes: 5 additions & 1 deletion docs/reference/models/openai.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,11 @@

!!! Installation

You need to install the `openai` library to be able to use the OpenAI API in Outlines.
You need to install the `openai` library to be able to use the OpenAI API in Outlines. Or alternatively:

```bash
pip install "outlines[openai]"
```

## OpenAI models

Expand Down
4 changes: 2 additions & 2 deletions docs/reference/models/transformers.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,10 @@

!!! Installation

You need to install the `transformer`, `datasets` and `torch` libraries to be able to use these models in Outlines:
You need to install the `transformer`, `datasets` and `torch` libraries to be able to use these models in Outlines, or alternatively:

```bash
pip install torch transformers datasets
pip install "outlines[transformers]"
```


Expand Down
6 changes: 5 additions & 1 deletion docs/reference/models/vllm.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,11 @@

!!! Note "Installation"

You need to install the `vllm` library to use the vLLM integration. See the [installation section](#installation) for instructions to install vLLM for CPU or ROCm.
You need to install the `vllm` library to use the vLLM integration. See the [installation section](#installation) for instructions to install vLLM for CPU or ROCm. To get started you can also run:

```bash
pip install "outlines[vllm]"
```

## Load the model

Expand Down

0 comments on commit b504ad3

Please sign in to comment.