Lost in Translation: Why Lower Bias Scores Don't Mean Fairer Models

Harsh Kumar

Bias audits of multilingual language models usually compare a model's average stereotype score in English with its average in another language and read the difference as a differen…