Mapping OpenAI CLIP Modified ResNet weights -> ByobNet. #2198

Merged

rwightman merged 6 commits intomainfrom openai_clip_resnet

Jun 12, 2024

+656-200

Commits on Jun 9, 2024

Mapping OpenAI CLIP Modified ResNet weights -> ByobNet. Improve AttentionPool2d layers. Fix #1731
rwightman
committed

Commits on Jun 10, 2024

Remove separate ConvNormActAa class, merge with ConvNormAct
rwightman
committed
Adding pos embed resize fns to FX autowrap exceptions
rwightman
committed
Fix load of larger ResNet CLIP models, experimenting with making AttentionPool *the* head, seems to fine-tune better, one less layer.
rwightman
committed

Commits on Jun 12, 2024