-
Notifications
You must be signed in to change notification settings - Fork 199
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
deepseek-vl系列的微调支持 (finetune) #10
Comments
Thank you for supporting DeepSeek-VL! |
@Jintao-Huang Can you kindly confirm if swift can be used to finetune visual encoder? If so, how? If not, what's the simplest way to support it? |
还有就是lora微调后怎么部署使用 |
@soloice Thank you very much for asking |
LoRA fine-tuning and merge-LoRA have been supported for both the visual encoder and aligner. |
I am super grateful for your work, thank you a lot!!! ❤️ |
ms-swift大模型训练框架已经支持了deepseek-vl系列模型的推理和微调~
最佳实践可以查看这里:
https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/deepseek-vl%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md
The text was updated successfully, but these errors were encountered: