Revisiting Step-Size Assumptions in Stochastic Approximation

Caio Kalil Lauand, Sean Meyn

Many machine learning and optimization algorithms are built upon the framework of stochastic approximation (SA), for which the selection of step-size (or learning rate) $\{\hat{I}{\pm }_n\}$…