The surprising efficiency of temporal difference learning for rare event prediction

Xiaoou Cheng, Jonathan Weare

We quantify the efficiency of temporal difference (TD) learning over the direct, or Monte Carlo (MC), estimator for policy evaluation in reinforcement learning, with an emphasis on…