How VLLM load Mistral Pixtral without Huggingface Config File? #10187
Unanswered
galaxy202411
asked this question in
Q&A
Replies: 1 comment
-
We know to load the repo in Mistral format via the CLI argument |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I loaded Mistral Pixtral by vllm successfully. It's great.
However, it made me confused that pixtral in HF did not have any HF config file. Please refer to https://huggingface.co/mistralai/Pixtral-12B-2409/tree/main
How VLLM know the model type without any HF config file?
Beta Was this translation helpful? Give feedback.
All reactions