The ODE Method and Spectral Theory of Markov Operators

J. Huang, I. Kontoyiannis, S. P. Meyn

We give a development of the ODE method for the analysis of recursive algorithms described by a stochastic recursion. With variability modelled via an underlying Markov process, an…