Stubborn Lexical Bias in Data and Models

Sofia Serrano, Jesse Dodge, Noah A. Smith

In NLP, recent work has seen increased focus on spurious correlations between various features and labels in training data, and how these influence model behavior. However, the pre…