Sample Complexity Analysis for Adaptive Optimization Algorithms with Stochastic Oracles

Billy Jin, Katya Scheinberg, Miaolan Xie

Several classical adaptive optimization algorithms, such as line search and trust region methods, have been recently extended to stochastic settings where function values, gradient…