Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorporate Liger #104

Open
fabianlim opened this issue Nov 8, 2024 · 0 comments
Open

Incorporate Liger #104

fabianlim opened this issue Nov 8, 2024 · 0 comments
Labels
dependency Issue arises because of a dependency help wanted Extra attention is needed triton involves triton kernels

Comments

@fabianlim
Copy link
Contributor

We currently have unsloth kernels in the FOAK plugin:

However, Liger is coming up strong with a lot of great developments, like AMD support. So perhaps we should also integrate liger kernels, and allow users the ability to switch to them in the configs.

Things to consider

@fabianlim fabianlim added help wanted Extra attention is needed dependency Issue arises because of a dependency triton involves triton kernels labels Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependency Issue arises because of a dependency help wanted Extra attention is needed triton involves triton kernels
Projects
None yet
Development

No branches or pull requests

1 participant