Easy attention: A simple attention mechanism for temporal predictions with transformers

Marcial Sanchis-Agudo, Yuning Wang, Roger Arnau +4

To improve the robustness of transformer neural networks used for temporal-dynamics prediction of chaotic systems, we propose a novel attention mechanism called easy attention whic…