Perturbation-based Self-supervised Attention for Attention Bias in Text Classification

Huawen Feng, Zhenxi Lin, Qianli Ma

In text classification, the traditional attention mechanisms usually focus too much on frequent words, and need extensive labeled data in order to learn. This paper proposes a pert…