[Bug] Docker image guardrails-hallucination-detection build fail

[ZePan110]

Priority

P2

OS type

Ubuntu

Hardware type

Xeon-SPR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other

Deploy method

• Docker
• Docker Compose
• Kubernetes Helm Charts
• Other

Running nodes

Single Node

What's the version?

53fcc6f

Description

guardrails-hallucination-detection docker image build fail

guardrails-hallucination-detection:
    build:
      dockerfile: comps/guardrails/src/hallucination_detection/Dockerfile
    image: ${REGISTRY:-opea}/guardrails-hallucination-detection:${TAG:-latest}

Job link: https://github.com/opea-project/GenAIComps/actions/runs/12900670469/job/35971526507#step:5:3927

Reproduce steps

docker compose build --no-cache .github/workflows/docker/compose/guardrails-compose.yaml

Raw log

Attachments

No response

[qgao007]

Hi @ZePan110 , the guardrail currently only supports Gaudi 2 hardware not SPR, due to performance considerations. Once we develop quantized or optimized version of guardrail, we can enable SRP support. Please let me know if you need further clarification. Adding @lvliang-intel @ashahba for their awareness.

[ashahba]

@qgao007 I think we still want to make sure you can build the image on SPR.
For runtime if it requires Gaudi 2, that's not an issue.

[ashahba]

Maybe same as #1207 but we'll double check.
@dmsuehir @okhleif-IL

[dmsuehir]

I was able to build this locally on Xeon (CLX):

docker build --no-cache -t opea/hallucination-detection:comps --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/guardrails/src/hallucination_detection/Dockerfile .
[+] Building 146.1s (11/11) FINISHED                                                                                                                                                                  docker:default
 => [internal] load build definition from Dockerfile                                                                                                                                                            0.0s
 => => transferring dockerfile: 975B                                                                                                                                                                            0.0s
 => [internal] load metadata for docker.io/library/python:3.11-slim                                                                                                                                             0.9s
 => [internal] load .dockerignore                                                                                                                                                                               0.0s
 => => transferring context: 2B                                                                                                                                                                                 0.0s
 => CACHED [1/6] FROM docker.io/library/python:3.11-slim@sha256:6ed5bff4d7d377e2a27d9285553b8c21cfccc4f00881de1b24c9bc8d90016e82                                                                                0.0s
 => [internal] load build context                                                                                                                                                                               0.0s
 => => transferring context: 58.05kB                                                                                                                                                                            0.0s
 => [2/6] RUN apt-get update -y && apt-get install -y --no-install-recommends --fix-missing     libgl1-mesa-glx     libjemalloc-dev                                                                             7.2s
 => [3/6] RUN useradd -m -s /bin/bash user &&     mkdir -p /home/user &&     chown -R user /home/user/                                                                                                          0.2s 
 => [4/6] COPY comps /home/user/comps                                                                                                                                                                           0.1s 
 => [5/6] RUN pip install --no-cache-dir --upgrade pip &&     if [ cpu = "cpu" ]; then       pip install --no-cache-dir --extra-index-url https://download.pytorch.org/whl/cpu -r /home/user/comps/guardrail  121.9s 
 => [6/6] WORKDIR /home/user/comps/guardrails/src/hallucination_detection                                                                                                                                       0.0s 
 => exporting to image                                                                                                                                                                                         15.7s 
 => => exporting layers                                                                                                                                                                                        15.7s 
 => => writing image sha256:1f3a4a18a6ff9a6a378025546f3d72de28f04d7352de415daf3778824b235d80                                                                                                                    0.0s 
 => => naming to docker.io/opea/hallucination-detection:comps