2 papers
cs.LG2026
A Unified Analysis of Importance-Corrected Momentum Actor-Critic over a Markovian Trajectory
Yanjie Dong, Zhou Su, Wei Wang +1
We present a generic actor-critic method that combines a ridge-regularized pathwise least-squares temporal-difference (LSTD) critic with importance-corrected momentum (ICM) actors.…
cs.LG2024
Heavy-Ball Momentum Accelerated Actor-Critic With Function Approximation
Yanjie Dong, Haijun Zhang, Gang Wang +2
By using an parametric value function to replace the Monte-Carlo rollouts for value estimation, the actor-critic (AC) algorithms can reduce the variance of stochastic policy gradie…