TDprop: Does Jacobi Preconditioning Help Temporal Difference Learning?

Joshua Romoff, Peter Henderson, David Kanaa +4

We investigate whether Jacobi preconditioning, accounting for the bootstrap term in temporal difference (TD) learning, can help boost performance of adaptive optimizers. Our method…