Skip to content

Commit

Permalink
black
Browse files Browse the repository at this point in the history
  • Loading branch information
rachelspark committed Oct 17, 2023
1 parent 85b59a7 commit 6aef818
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion 06_gpu_and_ml/vllm_inference.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,9 @@ def download_model_to_folder():
"torch==2.0.1+cu118", index_url="https://download.pytorch.org/whl/cu118"
)
# Pinned to 10/16/23
.pip_install("vllm @ git+https://github.com/vllm-project/vllm.git@651c614aa43e497a2e2aab473493ba295201ab20")
.pip_install(
"vllm @ git+https://github.com/vllm-project/vllm.git@651c614aa43e497a2e2aab473493ba295201ab20"
)
# Use the barebones hf-transfer package for maximum download speeds. No progress bar, but expect 700MB/s.
.pip_install("hf-transfer~=0.1")
.env({"HF_HUB_ENABLE_HF_TRANSFER": "1"})
Expand Down

0 comments on commit 6aef818

Please sign in to comment.