The Implicit Regularization of Momentum Gradient Descent with Early Stopping

Li Wang, Yingcong Zhou, Zhiguo Fu

The study on the implicit regularization induced by gradient-based optimization is a longstanding pursuit. In the present paper, we characterize the implicit regularization of mome…