Attention, please! A survey of Neural Attention Models in Deep Learning

Alana de Santana Correia, Esther Luna Colombini

In humans, Attention is a core property of all perceptual and cognitive operations. Given our limited ability to process competing sources, attention mechanisms select, modulate, a…