Central Limit Theorems for Transition Probabilities of Controlled Markov Chains

Ziwei Su, Imon Banerjee, Diego Klabjan

We develop a central limit theorem (CLT) for a non-parametric estimator of the transition matrices in controlled Markov chains (CMCs) with finite state-action spaces. Our results e…