Making Attention Mechanisms More Robust and Interpretable with Virtual Adversarial Training

Shunsuke Kitada, Hitoshi Iyatomi

Although attention mechanisms have become fundamental components of deep learning models, they are vulnerable to perturbations, which may degrade the prediction performance and mod…