On the Interpretability of Attention Networks

Lakshmi Narayan Pandey, Rahul Vashisht, Harish G. Ramaswamy

Attention mechanisms form a core component of several successful deep learning architectures, and are based on one key idea: ''The output depends only on a small (but unknown) segm…