Skip to content

Commit

Permalink
Update transformers-tinyllama.yaml
Browse files Browse the repository at this point in the history
Signed-off-by: Ettore Di Giacinto <[email protected]>
  • Loading branch information
mudler authored Jan 26, 2024
1 parent 9f1be45 commit 670cee8
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions embedded/models/transformers-tinyllama.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ parameters:
model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
temperature: 0.2
top_k: 40
seed: -1
top_p: 0.95
max_tokens: 4096

Expand All @@ -29,4 +28,4 @@ usage: |
"model": "tinyllama-chat",
"messages": [{"role": "user", "content": "Say this is a test!"}],
"temperature": 0.7
}'
}'

0 comments on commit 670cee8

Please sign in to comment.