VDSC: Enhancing Exploration Timing with Value Discrepancy and State Counts

Marius Captari, Remo Sasso, Matthia Sabatelli

Despite the considerable attention given to the questions of \textit{how much} and \textit{how to} explore in deep reinforcement learning, the investigation into \textit{when} to e…