Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes

Si Yi Meng, Antonio Orvieto, Daniel Yiming Cao +1

We study gradient descent (GD) dynamics on logistic regression problems with large, constant step sizes. For linearly-separable data, it is known that GD converges to the minimizer…