When Does Non-Uniform Replay Matter in Reinforcement Learning?

Michal Korniak, Mikołaj Czarnecki, Yarden As +3

Modern off-policy reinforcement learning algorithms often rely on simple uniform replay sampling and it remains unclear when and why non-uniform replay improves over this strong ba…