Temporal-difference learning with nonlinear function approximation: lazy training and mean field regimes

Andrea Agazzi, Jianfeng Lu

We discuss the approximation of the value function for infinite-horizon discounted Markov Reward Processes (MRP) with nonlinear functions trained with the Temporal-Difference (TD)…