The Benefits of Being Distributional: Small-Loss Bounds for Reinforcement Learning

Kaiwen Wang, Kevin Zhou, Runzhe Wu +2

While distributional reinforcement learning (DistRL) has been empirically effective, the question of when and why it is better than vanilla, non-distributional RL has remained unan…