A Theoretical Analysis of Generalization Dynamics in Neural Networks under Gradient Descent with Weight Decay

Yuqing Wang, Ioannis G. Kevrekidis, Mikhail Belkin

Understanding generalization remains a central challenge in machine learning because it requires jointly considering data, architecture, and training dynamics. In this paper, we de…