Target Updates May Stabilize Linear Q-Learning: Periodic and Soft Dynamics

Donghwan Lee

Periodic target updates in Q-learning and soft target updates in actor-critic methods are empirically well established stabilization mechanisms, but their precise theoretical expla…