Markov Chain Variance Estimation: A Stochastic Approximation Approach

Shubhada Agrawal, Prashanth L. A., Siva Theja Maguluri

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design…