Escape saddle points by a simple gradient-descent based algorithm

Chenyi Zhang, Tongyang Li

Escaping saddle points is a central research topic in nonconvex optimization. In this paper, we propose a simple gradient-based algorithm such that for a smooth function $f\colon\m…