Skip to content

Commit

Permalink
Fix text-generation-server dependency installation from `poetry.loc…
Browse files Browse the repository at this point in the history
…k` (#125)

The rebuilding of the container was failing because there was a conflict
with the dependencies most likely due to loose pining on those, but
since the `poetry.lock` is available within the repository, the safest
would be to install those dependencies from the requirements pinned
within the lock
  • Loading branch information
alvarobartt authored Dec 2, 2024
1 parent 5baddf5 commit edc876d
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion containers/tgi/gpu/2.1.1/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -242,7 +242,10 @@ COPY --from=tgi /tgi/server/Makefile server/Makefile
RUN cd server && \
make gen-server && \
pip install -r requirements_cuda.txt && \
pip install ".[bnb, accelerate, quantize, peft, outlines]" --no-cache-dir
pip install poetry && \
poetry export -f requirements.txt --extras "bnb accelerate quantize peft outlines" --output requirements_poetry.txt && \
pip install -r requirements_poetry.txt && \
pip install .

# Deps before the binaries
# The binaries change on every build given we burn the SHA into them
Expand Down

0 comments on commit edc876d

Please sign in to comment.