Heavy-Ball Momentum Accelerated Actor-Critic With Function Approximation

Yanjie Dong, Haijun Zhang, Gang Wang +2

By using an parametric value function to replace the Monte-Carlo rollouts for value estimation, the actor-critic (AC) algorithms can reduce the variance of stochastic policy gradie…