Variance Reduction for Deep Q-Learning using Stochastic Recursive Gradient

Haonan Jia, Xiao Zhang, Jun Xu +4

Deep Q-learning algorithms often suffer from poor gradient estimations with an excessive variance, resulting in unstable training and poor sampling efficiency. Stochastic variance-…