Gradient Descent on Logistic Regression: Do Large Step-Sizes Work with Data on the Sphere?

Si Yi Meng, Baptiste Goujaud, Antonio Orvieto +1

Gradient descent (GD) on logistic regression has many fascinating properties. When the dataset is linearly separable, it is known that the iterates converge in direction to the max…