T2 config for DeiT-S training in the ResNet strikes back paper #922
Unanswered
changlin31
asked this question in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi @rwightman
I am curious about the T2 config for DeiT-S training mentioned in your paper. Do you also use LAMB optimizer in this config? Could you share more details of this config?
Thanks in advance.
Beta Was this translation helpful? Give feedback.
All reactions