A Diffusion Approximation for Temporal-Difference Learning with Linear Features under Markovian Noise

M. Forzo, E. Monzio Compagnoni, A. Russo +1

Temporal difference (TD) learning with linear function approximation is a core method for policy evaluation. Its classical continuous-time description is an ordinary differential e…