From edc876d9535696d484adb35164e3c4ed07d5e20e Mon Sep 17 00:00:00 2001 From: Alvaro Bartolome <36760800+alvarobartt@users.noreply.github.com> Date: Mon, 2 Dec 2024 19:35:08 +0100 Subject: [PATCH] Fix `text-generation-server` dependency installation from `poetry.lock` (#125) The rebuilding of the container was failing because there was a conflict with the dependencies most likely due to loose pining on those, but since the `poetry.lock` is available within the repository, the safest would be to install those dependencies from the requirements pinned within the lock --- containers/tgi/gpu/2.1.1/Dockerfile | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/containers/tgi/gpu/2.1.1/Dockerfile b/containers/tgi/gpu/2.1.1/Dockerfile index 35b13e23..2eec4bc1 100644 --- a/containers/tgi/gpu/2.1.1/Dockerfile +++ b/containers/tgi/gpu/2.1.1/Dockerfile @@ -242,7 +242,10 @@ COPY --from=tgi /tgi/server/Makefile server/Makefile RUN cd server && \ make gen-server && \ pip install -r requirements_cuda.txt && \ - pip install ".[bnb, accelerate, quantize, peft, outlines]" --no-cache-dir + pip install poetry && \ + poetry export -f requirements.txt --extras "bnb accelerate quantize peft outlines" --output requirements_poetry.txt && \ + pip install -r requirements_poetry.txt && \ + pip install . # Deps before the binaries # The binaries change on every build given we burn the SHA into them