Simpson's Bias in NLP Training

Fei Yuan, Longtu Zhang, Huang Bojun +1

In most machine learning tasks, we evaluate a model $M$ on a given data population $S$ by measuring a population-level metric $F(S;M)$. Examples of such evaluation metric $F$ inclu…