Statistical Inference for Policy Evaluation with Temporal Difference Learning

Weichen Wu, Gen Li, Yuting Wei +1

We investigate the statistical properties of Temporal Difference (TD) learning with Polyak-Ruppert averaging, arguably one of the most widely used algorithms in reinforcement learn…