Mean squared error reduction of (plug-in) look-ahead estimators for Markov chains

Romain Azaïs, Benoît Henry, Henri Péchoux

We consider the estimation of the invariant distribution $\pi$ of a Markov kernel on a discrete state space (or of the mean value $\pi (f)$ of a functional $f$ under $\pi$) when solving t…