Gradient descent avoids strict saddles with a simple line-search method too

Andreea-Alexandra Muşat, Andreea-Alexandra Musat, Nicolas Boumal

It is known that gradient descent (GD) on a $C^2$ cost function generically avoids strict saddle points when using a small, constant step size. However, no such guarantee existed f…