On the Convergence of Semi-Gradient TD: A Mean Field Perspective

Haruki Settai, Tadashi Kozuno, Shinji Ito

Semi-gradient temporal-difference learning is a core algorithmic component of reinforcement learning, but bootstrapping with function approximation generally induces a non-conserva…