Skip to content
This repository has been archived by the owner on Oct 16, 2023. It is now read-only.

3 three steps for training any model? #1

Open
jeannotes opened this issue Mar 19, 2023 · 0 comments
Open

3 three steps for training any model? #1

jeannotes opened this issue Mar 19, 2023 · 0 comments

Comments

@jeannotes
Copy link

hi, thanks for your repo,
after read your code for traing with mmdetection-related framework, seems that you write those three fundamental code:

optimizer = HybridAdam(model.parameters())
model = zero_model_wrapper(model, zero_stage=2)
optimizer = zero_optim_wrapper(
    model, optimizer, optim_config=ZERO_OPTIM_CFG)

if this, we lose the general unitily of training of those specified frameworks, eg: those hooks.
maybe we can add those three lines of code to our framework inside, should that work?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant