Added RAdamScheduleFree support #1830
Merged
+5
−1
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
初めまして。
先日RAdamScheduleFreeというoptimizerを公開したものです。
公開時ポスト
紹介記事
記事公開後、「sd-scriptsに追加されると嬉しい」旨のポストを見かけたため僭越ながら追加のPRを作成させていただきました。
branchを見るとscheduler-free-optとsd3が現状schedulefreeに対応していそうで、sd3の方が最新なのかなという気配がしたのでこちらで対応させていただきましたが、もし何か問題等ありましたらお気軽にお申し付けください。
[Just in case you're an English speaker reading this PR:]
Hi there,
I'm the developer who recently released the RAdamScheduleFree optimizer.
I saw someone post that they'd like to have RAdamScheduleFree added to sd-scripts, so I just made this PR.
Please let me know if there are any issues or concerns. Thank you.