Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction

Xingguo Chen, Zhiang He, Yuchen Shen +4

Temporal-difference learning with function approximation can be unstable under off-policy sampling. TDC stabilizes off-policy TD through an auxiliary covariance correction, and TDR…