Unbiased time-average estimators for Markov chains

Nabil Kahale

We consider a time-average estimator $f_k$ of a functional of a Markov chain. Under a coupling assumption, we show that the expectation of $f_k$ has a limit $\mu$ as the number o…