AFU: Actor-Free critic Updates in off-policy RL for continuous control

Nicolas Perrin-Gilbert

This paper presents AFU, an off-policy deep RL algorithm addressing in a new way the challenging "max-Q problem" in Q-learning for continuous action spaces, with a solution based o…