The Fair Language Model Paradox

Andrea Pinto, Tomer Galanti, Randall Balestriero

Large Language Models (LLMs) are widely deployed in real-world applications, yet little is known about their training dynamics at the token level. Evaluation typically relies on ag…