Extending the step-size restriction for gradient descent to avoid strict saddle points

Hayden Schaeffer, Scott G. McCalla

We provide larger step-size restrictions for which gradient descent based algorithms (almost surely) avoid strict saddle points. In particular, consider a twice differentiable (non…