Skaling: Chinchilla's Exponents Meet Kaplan's Coupling

Mathurin Videau, Badr Youbi-Idrissi, David Lopez-Paz +1

Neural scaling laws are foundational for language model development, yet standard formulations systematically under- and overestimate loss at data-scarce and overtraining extremes.…