homerjed / simple_vision_transformer Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Lightweight implementation of 'An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale' (Dosovitskiy++21) in JAX.

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
.gitignore		.gitignore
README.md		README.md
vit.py		vit.py
vit_circles.ipynb		vit_circles.ipynb
vit_digits.ipynb		vit_digits.ipynb

Repository files navigation

Simple Vision Transformer (ViT)

Implementation of 'An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale' (Dosovitskiy++21) in jax and equinox.

Uses simple attention mechanism for pedagogical reasons.

About

Lightweight implementation of 'An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale' (Dosovitskiy++21) in JAX.

Report repository

Releases

No releases published

Packages

No packages published

Languages