Skip to content

Commit

Permalink
fix: add build_vulkan commands for amd64/arm64 on Makefile
Browse files Browse the repository at this point in the history
Signed-off-by: lstocchi <[email protected]>
  • Loading branch information
lstocchi committed Jun 27, 2024
1 parent 321653e commit 3794186
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 6 deletions.
8 changes: 5 additions & 3 deletions model_servers/llamacpp_python/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -19,9 +19,11 @@ all: build download-model-granite run
build-cuda:
"${CONTAINER_TOOL}" build --squash-all -t $(CUDA_IMAGE) . -f cuda/Containerfile

.PHONY: build-vulkan
build-vulkan:
"${CONTAINER_TOOL}" build --squash-all -t $(VULKAN_IMAGE) . -f vulkan/Containerfile
.PHONY: build-vulkan-amd64 build-vulkan-arm64
build-vulkan-amd64:
"${CONTAINER_TOOL}" build --squash-all -t $(VULKAN_IMAGE) . -f vulkan/amd64/Containerfile
build-vulkan-arm64:
"${CONTAINER_TOOL}" build --squash-all -t $(VULKAN_IMAGE) . -f vulkan/arm64/Containerfile

.PHONY: download-model-granite # default model
download-model-granite:
Expand Down
8 changes: 5 additions & 3 deletions model_servers/llamacpp_python/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,9 +61,11 @@ The [Vulkan image](../llamacpp_python/vulkan/Containerfile) is experimental, but

To build the Vulkan model service variant image:

```bash
make -f Makefile build-vulkan
```
| System Architecture | Command |
|---|---|
| amd64 | make -f Makefile build-vulkan-amd64 |
| arm64 | make -f Makefile build-vulkan-arm64 |

To pull the base model service image:

```bash
Expand Down

0 comments on commit 3794186

Please sign in to comment.