Markovian Foundations for Quasi-Stochastic Approximation in Two Timescales: Extended Version

Caio Kalil Lauand, Sean Meyn

Many machine learning and optimization algorithms can be cast as instances of stochastic approximation (SA). The convergence rate of these algorithms is known to be slow, with the…