Markovian Foundations for Quasi-Stochastic Approximation with Applications to Extremum Seeking Control

Caio Kalil Lauand, Sean Meyn

This paper concerns quasi-stochastic approximation (QSA) to solve root finding problems commonly found in applications to optimization and reinforcement learning. The general const…