Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MLX Support #1119

Open
fakerybakery opened this issue Jan 14, 2024 · 2 comments
Open

MLX Support #1119

fakerybakery opened this issue Jan 14, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@fakerybakery
Copy link

fakerybakery commented Jan 14, 2024 •
edited
Loading

Hi,
It would be great to have MLX support in Axolotl. MLX has been shown to be able to quickly and efficiently finetune many LLMs, including 7B LLMs on consumer hardware.
Thank you!

(edit: update)
@fakerybakery fakerybakery added the enhancement New feature or request label Jan 14, 2024
@winglian
Copy link
Collaborator

winglian commented Jan 14, 2024 •
edited
Loading

These will be helpful

https://github.com/philipturner/metal-flash-attention

ml-explore/mlx#129

@fakerybakery
Copy link
Author

fakerybakery commented Feb 12, 2024 •
edited
Loading

Since #1264 is merged, should I close this issue or are there plans to implement MLX support in the future (since MLX can be much faster)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@winglian @fakerybakery