Implicit vs. explicit regularization for high-dimensional gradient descent

Thomas Stark, Lukas Steinberger

In this paper we investigate the generalization error of gradient descent (GD) applied to an ${\ell }_2$-regularized OLS objective function in the linear model. Based on our analysis…