Create a GPT2 compatible transformer implementation #31
Labels
enhancement
New feature or request
help wanted
Extra attention is needed
project:TTP
For the Tiny Transformer Playground
GPT2 is a very standard transformer implementation (e.g. used in Andrej Karpathy's rather famous introduction to transformers: https://www.youtube.com/watch?v=kCc8FmEb1nY).
The text was updated successfully, but these errors were encountered: