Escaping Saddle Points for Zeroth-order Nonconvex Optimization using Estimated Gradient Descent

Qinbo Bai, Mridul Agarwal, Vaneet Aggarwal

Gradient descent and its variants are widely used in machine learning. However, oracle access of gradient may not be available in many applications, limiting the direct use of grad…