The Dialect Tax: Dialectal Biases Persist throughout the Language Modeling Pipeline

Elle

Systematic dialectal performance gaps in language models (LMs) are well documented, but the source of these disparities within the modern language modeling pipeline remains unclear…