This package implements the attention mechanism as a Lux layer. It can then be used for closure modeling.
using Pkg
Pkg.add("[email protected]:DEEPDIP-project/AttentionLayer.jl.git")Look in test/ for examples on how to use the package.
If you use AttentionLayer.jl in your work, please cite using the reference given in CITATION.cff.
If you want to make contributions of any kind, please first that a look into our contributing guide directly on GitHub or the contributing page on the website
 SCiarella 💻 |