Skip to content

Commit

Permalink
Fix dependency installation from poetry.lock
Browse files Browse the repository at this point in the history
The rebuilding of the container was failing because there was a conflict
with the dependencies most likely due to loose pining on those, but
since the `poetry.lock` is available within the repository, the safest
would be to install those dependencies from the requirements pinned
within the lock
  • Loading branch information
alvarobartt committed Nov 28, 2024
1 parent d34057a commit 2f0ed64
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion containers/tgi/gpu/2.1.1/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -242,7 +242,10 @@ COPY --from=tgi /tgi/server/Makefile server/Makefile
RUN cd server && \
make gen-server && \
pip install -r requirements_cuda.txt && \
pip install ".[bnb, accelerate, quantize, peft, outlines]" --no-cache-dir
pip install poetry && \
poetry export -f requirements.txt --extras "bnb accelerate quantize peft outlines" --output requirements_poetry.txt && \
pip install -r requirements_poetry.txt && \
pip install .

# Deps before the binaries
# The binaries change on every build given we burn the SHA into them
Expand Down

0 comments on commit 2f0ed64

Please sign in to comment.