On the Dynamics of Delayed Generalization in Linear Models

Nataraj Das, Atreya Vedantam, Chandrashekar Lakshminarayanan

Delayed generalization, where training accuracy becomes nearly perfect substantially before test accuracy, has often been studied in the context of the depth and compositional stru…