GitHub - adamimos/transformerPlayground: Playing around with transformers, on the path towards CCA analysis

adamimos / transformerPlayground Public

Playing around with transformers, on the path towards CCA analysis

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
__pycache__		__pycache__
.gitattributes		.gitattributes
.gitignore		.gitignore
PDFA.py		PDFA.py
autoencoder_superposition.ipynb		autoencoder_superposition.ipynb
bigram.py		bigram.py
graph.gv.pdf		graph.gv.pdf
modular_addition.ipynb		modular_addition.ipynb
modular_addition_2head.ipynb		modular_addition_2head.ipynb
modular_addition_grokk.ipynb		modular_addition_grokk.ipynb
modular_addition_subtraction.ipynb		modular_addition_subtraction.ipynb
modular_addition_subtraction_more.ipynb		modular_addition_subtraction_more.ipynb
modular_subtraction.ipynb		modular_subtraction.ipynb
output.svg		output.svg
shakespear_data.txt		shakespear_data.txt
superposition.ipynb		superposition.ipynb
test_generative_processes.py		test_generative_processes.py
test_transformer_model.py		test_transformer_model.py
transformer_lib.py		transformer_lib.py
transformer_playground.ipynb		transformer_playground.ipynb