Relative Scaling Laws for LLMs

William Held, David Hall, Percy Liang +1

Scaling laws describe how language models improve with additional data, parameters, and compute. While widely used, they are typically measured on aggregate test sets. Aggregate ev…