You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi. Does anyone know how to pre-train a ViT model on ImageNet-21K dataset?
For example, I would like to pre-train a ViT-Base model on ImageNet-21K than finetune on ImageNet-1K. How to set the augmentation/regularization hyper-parameters? How to set learning rate, weight decay, etc.?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi. Does anyone know how to pre-train a ViT model on ImageNet-21K dataset?
For example, I would like to pre-train a ViT-Base model on ImageNet-21K than finetune on ImageNet-1K. How to set the augmentation/regularization hyper-parameters? How to set learning rate, weight decay, etc.?
Beta Was this translation helpful? Give feedback.
All reactions