Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial support #1

Open
wants to merge 57 commits into
base: main
Choose a base branch
from
Open

Initial support #1

wants to merge 57 commits into from

Conversation

dc-dc-dc
Copy link

No description provided.

@dc-dc-dc dc-dc-dc marked this pull request as ready for review January 23, 2024 21:25
@simonw
Copy link

simonw commented May 9, 2024

I can't wait to try this out, I want to run https://huggingface.co/microsoft/Phi-3-mini-128k-instruct-onnx on my Mac!

@awni
Copy link
Member

awni commented May 10, 2024

Just curious, why not use this one https://huggingface.co/microsoft/Phi-3-mini-128k-instruct with MLX LM? That should already work quite well.

@csukuangfj
Copy link

1 month has passed. Is there any update?

@awni
Copy link
Member

awni commented Jun 10, 2024

Can you say more about your use case for this @csukuangfj ?

@csukuangfj
Copy link

I want to create sherpa-mlx similar to sherpa-onnx.

But the first obstacle is how to convert models from onnx to mlx.

sherpa-onnx supports different types of models, e.g.

  • zipformer, paraformer, whisper, etc., for speech recognition
  • vits for text-to-speech
  • 3d-speaker, wespeaker, models from NeMo, for speaker embedding extractor

If we can convert models from onnx to mlx, then it should be straightforward to create sherpa-mlx.

@awni
Copy link
Member

awni commented Jun 10, 2024

Makes sense, thanks! This PR needs a bit of work before we can land it. I don't have an ETA yet. But its good to know of your use case to help prioritize.

@csukuangfj
Copy link

Almost two months have passed.

Is there any update?

@awni
Copy link
Member

awni commented Aug 5, 2024

No update here yet, sorry 😔

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants