Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists

Giuseppe Attanasio, Debora Nozza, Dirk Hovy +1

Natural Language Processing (NLP) models risk overfitting to specific terms in the training data, thereby reducing their performance, fairness, and generalizability. E.g., neural h…