On the Limits of Biased Derivative Information for Nonconvex Stochastic Optimization

Anant Shyam, Brian Bullins

We consider the problem of finding $\delta$-stationary points for $\delta >0$, i.e., $x\in {\mathbb{R}}^d$ such that $||\nabla F(x)||\le \delta$, for smooth, non-convex objectives, where the deri…