Skip to content

Commit

Permalink
Synchronize kserve manifests v0.14.0 (kubeflow#2908)
Browse files Browse the repository at this point in the history
* Update kserve manifests from v0.14.0

Update kserve/kserve manifests from v0.14.0

Signed-off-by: juliusvonkohout <[email protected]>

* update kserve to 0.14

Signed-off-by: juliusvonkohout <[email protected]>

* update kserve to 0.14

Signed-off-by: juliusvonkohout <[email protected]>

* Update kserve manifests from v0.14.0

Update kserve/kserve manifests from v0.14.0

Signed-off-by: juliusvonkohout <[email protected]>

* update kserve to 0.14

Signed-off-by: juliusvonkohout <[email protected]>

* switch to server-side apply for too long annotations

Signed-off-by: juliusvonkohout <[email protected]>

* --force-conflicts

Signed-off-by: juliusvonkohout <[email protected]>

* --force-conflicts

Signed-off-by: juliusvonkohout <[email protected]>

---------

Signed-off-by: juliusvonkohout <[email protected]>
  • Loading branch information
juliusvonkohout authored Nov 4, 2024
1 parent f4664f4 commit 73cbecf
Show file tree
Hide file tree
Showing 6 changed files with 47,507 additions and 26,869 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ This repo periodically syncs all official Kubeflow components from their respect
| Tensorboards Web App | apps/tensorboard/tensorboards-web-app/upstream | [v1.9.2](https://github.com/kubeflow/kubeflow/tree/v1.9.2/components/crud-web-apps/tensorboards/manifests) |
| Volumes Web App | apps/volumes-web-app/upstream | [v1.9.2](https://github.com/kubeflow/kubeflow/tree/v1.9.2/components/crud-web-apps/volumes/manifests) |
| Katib | apps/katib/upstream | [v0.17.0](https://github.com/kubeflow/katib/tree/v0.17.0/manifests/v1beta1) |
| KServe | contrib/kserve/kserve | [0.13.0](https://github.com/kserve/kserve/releases/tag/v0.13.0) |
| KServe | contrib/kserve/kserve | [v0.14.0](https://github.com/kserve/kserve/releases/tag/v0.14.0/install/v0.14.0) |
| KServe Models Web App | contrib/kserve/models-web-app | [0.13.0](https://github.com/kserve/models-web-app/tree/0.13.0/config) |
| Kubeflow Pipelines | apps/pipeline/upstream | [2.3.0](https://github.com/kubeflow/pipelines/tree/2.3.0/manifests/kustomize) |
| Kubeflow Model Registry | apps/model-registry/upstream | [v0.2.9](https://github.com/kubeflow/model-registry/tree/v0.2.9/manifests/kustomize) |
Expand Down Expand Up @@ -145,7 +145,7 @@ kubectl create secret generic regcred \
You can install all Kubeflow official components (residing under `apps`) and all common services (residing under `common`) using the following command:

```sh
while ! kustomize build example | kubectl apply -f -; do echo "Retrying to apply resources"; sleep 20; done
while ! kustomize build example | kubectl apply --server-side --force-conflicts -f -; do echo "Retrying to apply resources"; sleep 20; done
```

Once, everything is installed successfully, you can access the Kubeflow Central Dashboard [by logging in to your cluster](#connect-to-your-kubeflow-cluster).
Expand Down Expand Up @@ -331,7 +331,7 @@ KFServing was rebranded to KServe.
Install the KServe component:

```sh
kustomize build contrib/kserve/kserve | kubectl apply -f -
kustomize build contrib/kserve/kserve | kubectl apply --server-side --force-conflicts -f -
```

Install the Models web application:
Expand Down
111 changes: 103 additions & 8 deletions contrib/kserve/kserve/kserve-cluster-resources.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ spec:
containers:
- args:
- --model_name={{.Name}}
image: kserve/huggingfaceserver:v0.13.1
image: kserve/huggingfaceserver:v0.14.0
name: kserve-container
resources:
limits:
Expand All @@ -18,6 +18,17 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
volumeMounts:
- mountPath: /dev/shm
name: devshm
hostIPC: false
protocolVersions:
- v2
- v1
Expand All @@ -26,6 +37,10 @@ spec:
name: huggingface
priority: 1
version: "1"
volumes:
- emptyDir:
medium: Memory
name: devshm
---
apiVersion: serving.kserve.io/v1alpha1
kind: ClusterServingRuntime
Expand All @@ -41,7 +56,7 @@ spec:
- --model_dir=/mnt/models
- --http_port=8080
- --nthread=1
image: kserve/lgbserver:v0.13.1
image: kserve/lgbserver:v0.14.0
name: kserve-container
resources:
limits:
Expand All @@ -50,6 +65,13 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
protocolVersions:
- v1
- v2
Expand Down Expand Up @@ -77,7 +99,7 @@ spec:
value: "9000"
- name: MODELS_DIR
value: /mnt/models
image: docker.io/seldonio/mlserver:1.3.2
image: docker.io/seldonio/mlserver:1.5.0
name: kserve-container
resources:
limits:
Expand All @@ -86,6 +108,13 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
protocolVersions:
- v2
supportedModelFormats:
Expand All @@ -101,14 +130,26 @@ spec:
name: xgboost
priority: 2
version: "1"
- autoSelect: true
name: xgboost
priority: 2
version: "2"
- autoSelect: true
name: lightgbm
priority: 2
version: "3"
- autoSelect: true
name: lightgbm
priority: 2
version: "4"
- autoSelect: true
name: mlflow
priority: 1
version: "1"
- autoSelect: true
name: mlflow
priority: 1
version: "2"
---
apiVersion: serving.kserve.io/v1alpha1
kind: ClusterServingRuntime
Expand All @@ -123,7 +164,7 @@ spec:
- --model_name={{.Name}}
- --model_dir=/mnt/models
- --http_port=8080
image: kserve/paddleserver:v0.13.1
image: kserve/paddleserver:v0.14.0
name: kserve-container
resources:
limits:
Expand All @@ -132,6 +173,13 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
protocolVersions:
- v1
- v2
Expand All @@ -154,7 +202,7 @@ spec:
- --model_name={{.Name}}
- --model_dir=/mnt/models
- --http_port=8080
image: kserve/pmmlserver:v0.13.1
image: kserve/pmmlserver:v0.14.0
name: kserve-container
resources:
limits:
Expand All @@ -163,6 +211,13 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
protocolVersions:
- v1
- v2
Expand All @@ -189,7 +244,7 @@ spec:
- --model_name={{.Name}}
- --model_dir=/mnt/models
- --http_port=8080
image: kserve/sklearnserver:v0.13.1
image: kserve/sklearnserver:v0.14.0
name: kserve-container
resources:
limits:
Expand All @@ -198,6 +253,13 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
protocolVersions:
- v1
- v2
Expand Down Expand Up @@ -233,6 +295,14 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
runAsUser: 1000
protocolVersions:
- v1
- grpc-v1
Expand Down Expand Up @@ -272,6 +342,14 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
runAsUser: 1000
protocolVersions:
- v1
- v2
Expand Down Expand Up @@ -307,6 +385,14 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
runAsUser: 1000
protocolVersions:
- v2
- grpc-v2
Expand Down Expand Up @@ -348,7 +434,7 @@ spec:
- --model_dir=/mnt/models
- --http_port=8080
- --nthread=1
image: kserve/xgbserver:v0.13.1
image: kserve/xgbserver:v0.14.0
name: kserve-container
resources:
limits:
Expand All @@ -357,6 +443,13 @@ spec:
requests:
cpu: "1"
memory: 2Gi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsNonRoot: true
protocolVersions:
- v1
- v2
Expand All @@ -372,7 +465,7 @@ metadata:
name: default
spec:
container:
image: kserve/storage-initializer:v0.13.1
image: kserve/storage-initializer:v0.14.0
name: storage-initializer
resources:
limits:
Expand All @@ -385,7 +478,9 @@ spec:
- prefix: gs://
- prefix: s3://
- prefix: hdfs://
- prefix: hf://
- prefix: webhdfs://
- regex: https://(.+?).blob.core.windows.net/(.+)
- regex: https://(.+?).file.core.windows.net/(.+)
- regex: https?://(.+)/(.+)
workloadType: initContainer
Loading

0 comments on commit 73cbecf

Please sign in to comment.