Skip to content

Issues: PAIR-code/tiny-transformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Create a GPT2 compatible transformer implementation enhancement New feature or request help wanted Extra attention is needed project:TTP For the Tiny Transformer Playground
#31 opened Sep 18, 2024 by iislucas
Create a Gemma compatible transformer implementation enhancement New feature or request help wanted Extra attention is needed project:TTP For the Tiny Transformer Playground
#30 opened Sep 18, 2024 by iislucas
Provide a visualization for the norms of different parts of a transformer model enhancement New feature or request project:TTP For the Tiny Transformer Playground
#25 opened Aug 28, 2024 by iislucas
Add decoder-style causal loss for predicting all tokens at once enhancement New feature or request project:TTP For the Tiny Transformer Playground
#17 opened Jul 23, 2024 by iislucas
Add dropout to Transformer implementation enhancement New feature or request project:TTP For the Tiny Transformer Playground
#1 opened Jun 16, 2023 by iislucas
5 tasks
ProTip! Updated in the last three days: updated:>2024-12-21.