Incorporate Liger #104
Labels
dependency
Issue arises because of a dependency
help wanted
Extra attention is needed
triton
involves triton kernels
We currently have unsloth kernels in the FOAK plugin:
However, Liger is coming up strong with a lot of great developments, like AMD support. So perhaps we should also integrate liger kernels, and allow users the ability to switch to them in the configs.
Things to consider
The text was updated successfully, but these errors were encountered: