Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

Use Transformer-XL approach to attend to many hours of recent history #179

Open
JackKelly opened this issue Jun 30, 2022 · 0 comments
Open

Use Transformer-XL approach to attend to many hours of recent history #179

JackKelly opened this issue Jun 30, 2022 · 0 comments
Labels
ML ML model tweak or big idea

Comments

@JackKelly
Copy link
Member

https://arxiv.org/pdf/1901.02860.pdf

I haven't fully understood the approach yet! After skim-reading, it feels more complex than Perceiver. So maybe stick to perceiver for now?!
@JackKelly JackKelly added the ML ML model tweak or big idea label Jun 30, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
ML ML model tweak or big idea
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JackKelly