Uncertainty quantification for Markov chain induced martingales with application to temporal difference learning

Weichen Wu, Yuting Wei, Alessandro Rinaldo

We establish novel and general high-dimensional concentration inequalities and Berry-Esseen bounds for vector-valued martingales induced by Markov chains. We apply these results to…