Unified Neural Scaling Laws

Ethan Caballero, Priyank Jaini, David Krueger +1

We present a functional form (that we refer to as a Unified Neural Scaling Law (UNSL)) that accurately models and extrapolates the scaling behaviors of deep neural networks as mult…