On TD(0) with function approximation: Concentration bounds and a centered variant with exponential convergence

Nathaniel Korda, L. A. Prashanth

We provide non-asymptotic bounds for the well-known temporal difference learning algorithm TD(0) with linear function approximators. These include high-probability bounds as well a…