Benefits of Early Stopping in Gradient Descent for Overparameterized Logistic Regression

Jingfeng Wu, Peter Bartlett, Matus Telgarsky +1

In overparameterized logistic regression, gradient descent (GD) iterates diverge in norm while converging in direction to the maximum ${\ell }_2$-margin solution -- a phenomenon known…