Efficiently Escaping Saddle Points under Generalized Smoothness via Self-Bounding Regularity

Daniel Yiming Cao, August Y. Chen, Karthik Sridharan +1

We study the optimization of non-convex functions that are not necessarily smooth (gradient and/or Hessian are Lipschitz) using first order methods. Smoothness is a restrictive ass…