Skip to content

Commit

Permalink
fix formatting and secrets argument
Browse files Browse the repository at this point in the history
  • Loading branch information
kning authored and aksh-at committed Feb 3, 2024
1 parent 10411dd commit 4eb9545
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion 06_gpu_and_ml/vllm_inference.py
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ def download_model_to_folder():
"hf-transfer==0.1.4",
"torch==2.1.2",
"torchvision==0.16.2",
"torchaudio==2.1.2"
"torchaudio==2.1.2",
)
# Use the barebones hf-transfer package for maximum download speeds. No progress bar, but expect 700MB/s.
.env({"HF_HUB_ENABLE_HF_TRANSFER": "1"})
Expand Down
2 changes: 1 addition & 1 deletion 06_gpu_and_ml/vllm_mixtral.py
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,7 @@ def download_model_to_folder():
"hf-transfer==0.1.4",
"torch==2.1.2",
"torchvision==0.16.2",
"torchaudio==2.1.2"
"torchaudio==2.1.2",
)
.env({"HF_HUB_ENABLE_HF_TRANSFER": "1"})
.run_function(download_model_to_folder, timeout=60 * 20)
Expand Down

0 comments on commit 4eb9545

Please sign in to comment.