Towards Understanding Asynchronous Advantage Actor-critic: Convergence and Linear Speedup

Han Shen, Kaiqing Zhang, Mingyi Hong +1

Asynchronous and parallel implementation of standard reinforcement learning (RL) algorithms is a key enabler of the tremendous success of modern RL. Among many asynchronous RL algo…