-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Initial support #1
base: main
Are you sure you want to change the base?
Conversation
I can't wait to try this out, I want to run https://huggingface.co/microsoft/Phi-3-mini-128k-instruct-onnx on my Mac! |
Just curious, why not use this one https://huggingface.co/microsoft/Phi-3-mini-128k-instruct with MLX LM? That should already work quite well. |
1 month has passed. Is there any update? |
Can you say more about your use case for this @csukuangfj ? |
I want to create But the first obstacle is how to convert models from onnx to mlx. sherpa-onnx supports different types of models, e.g.
If we can convert models from onnx to mlx, then it should be straightforward to create |
Makes sense, thanks! This PR needs a bit of work before we can land it. I don't have an ETA yet. But its good to know of your use case to help prioritize. |
Almost two months have passed. Is there any update? |
No update here yet, sorry 😔 |
No description provided.