On the stability of some controlled Markov chains and its applications to stochastic approximation with Markovian dynamic

Christophe Andrieu, Vladislav B. Tadić, Matti Vihola

We develop a practical approach to establish the stability, that is, the recurrence in a given set, of a large class of controlled Markov chains. These processes arise in various a…