Rethinking Population-assisted Off-policy Reinforcement Learning

Bowen Zheng, Ran Cheng

While off-policy reinforcement learning (RL) algorithms are sample efficient due to gradient-based updates and data reuse in the replay buffer, they struggle with convergence to lo…