A Generic Approach for Escaping Saddle points

Sashank J Reddi, Manzil Zaheer, Suvrit Sra +4

A central challenge to using first-order methods for optimizing nonconvex problems is the presence of saddle points. First-order methods often get stuck at saddle points, greatly d…