Skip to content
This repository has been archived by the owner on Aug 28, 2024. It is now read-only.

Commit

Permalink
update examples
Browse files Browse the repository at this point in the history
  • Loading branch information
samos123 committed Sep 5, 2023
1 parent cccdfbb commit c78e253
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 10 deletions.
11 changes: 6 additions & 5 deletions examples/llama2-70b/base-model.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,11 @@ metadata:
name: llama-2-70b
spec:
image: substratusai/model-loader-huggingface
env:
# You would first have to create a secret named `ai` that
# has the key `HUGGING_FACE_HUB_TOKEN` set to your token.
# E.g. create the secret by running:
# kubectl create secret generic ai --from-literal="HUGGING_FACE_HUB_TOKEN=<my-token>
HUGGING_FACE_HUB_TOKEN: ${{ secrets.ai.HUGGING_FACE_HUB_TOKEN }}
params:
name: meta-llama/Llama-2-70b-hf
# Make sure to replace ${HUGGINGFACE_TOKEN} with your token
# for example run this to use your own token:
# export HUGGINGFACE_TOKEN=replace-me-with-your-token
# cat base-model.yaml | envsubst | kubectl apply -f -
hugging_face_hub_token: ${HUGGINGFACE_TOKEN}
11 changes: 6 additions & 5 deletions examples/llama2-7b/base-model.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,11 @@ metadata:
name: llama-2-7b
spec:
image: substratusai/model-loader-huggingface
env:
# You would first have to create a secret named `ai` that
# has the key `HUGGING_FACE_HUB_TOKEN` set to your token.
# E.g. create the secret by running:
# kubectl create secret generic ai --from-literal="HUGGING_FACE_HUB_TOKEN=<my-token>
HUGGING_FACE_HUB_TOKEN: ${{ secrets.ai.HUGGING_FACE_HUB_TOKEN }}
params:
name: meta-llama/Llama-2-7b-hf
# Make sure to replace ${HUGGINGFACE_TOKEN} with your token
# for example run this to use your own token:
# export HUGGINGFACE_TOKEN=replace-me-with-your-token
# cat base-model.yaml | envsubst | kubectl apply -f -
hugging_face_hub_token: ${HUGGINGFACE_TOKEN}

0 comments on commit c78e253

Please sign in to comment.