jinmang2 / AdvancedTransformers Public

Notifications You must be signed in to change notification settings
Fork 3
Star 19

Code
Issues 14
Pull requests 1
Actions
Projects
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Actions
Projects
Security
Insights

Issues: jinmang2/AdvancedTransformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

14 Open 3 Closed

Author

Filter by author

Label

Filter by label

Use alt + click/return to exclude labels

or ⇧ + click/return for logical OR

Projects

Filter by project

Milestones

Filter by milestone

Assignee

Filter by who’s assigned

Assigned to nobody

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated Best match

Most reactions

Issues list

[Residual Connection] Commons features residual connection

#18 opened Jun 21, 2022 by jinmang2

[Activation Function] GeLU + Commons activation function features

#16 opened Jun 21, 2022 by jinmang2

15 tasks done

[Positional Embedding] Patch Embedding features positional embedding

#15 opened Jun 20, 2022 by jinmang2

[Feed Forward Network] DeBERTa features feed forward network

#14 opened Jun 20, 2022 by jinmang2

[Feed Forward Network] Commons features feed forward network

#13 opened Jun 20, 2022 by jinmang2

[Positional Embedding] Sinusoidal Encoding features positional embedding

#12 opened Apr 12, 2022 by jinmang2

[Positional Embedding] DeBERTa features positional embedding

#11 opened Apr 12, 2022 by jinmang2

[Positional Embedding] TUPE features positional embedding

#10 opened Apr 12, 2022 by jinmang2

[Positional Embedding] Transformer-XL features positional embedding

#9 opened Apr 12, 2022 by jinmang2

[Positional Embedding] T5-Bias features positional embedding

#8 opened Apr 12, 2022 by jinmang2

[Positional Embedding] Axial Positional Embedding features positional embedding

#7 opened Apr 12, 2022 by jinmang2

[Positional Embedding] Shaw's RPE features positional embedding

#6 opened Apr 12, 2022 by jinmang2

[Positional Embedding] Rotary Embedding features positional embedding

#5 opened Apr 12, 2022 by jinmang2

[Positional Embedding] Attention with Linear Biases features positional embedding

#4 opened Apr 12, 2022 by jinmang2

ProTip! Follow long discussions with comments:>50.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly