New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE]: Lora/QLora in GeminiPlugin and TorchFSDP #6138

Open

ericxsun opened this issue Nov 16, 2024 · 1 comment

Labels

Contributor

ericxsun commented Nov 16, 2024 •

edited

Loading

Describe the feature

How can we support LoRA/QLoRA in Gemini or TorchFSDP plugin?

If there’s documentation on this feature, it might encourage community contributions.

Thanks a lot.

ericxsun added the enhancement label

Contributor Author

ericxsun commented Nov 18, 2024

Fond this PR #5001.

It’s been a long time since the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment