Stochastic Second-order Methods for Non-convex Optimization with Inexact Hessian and Gradient

Liu Liu, Xuanqing Liu, Cho-Jui Hsieh +1

Trust region and cubic regularization methods have demonstrated good performance in small scale non-convex optimization, showing the ability to escape from saddle points. Each iter…