Optimistic Training and Convergence of Q-Learning -- Extended Version

Prashant Mehta, Sean Meyn

In recent work it is shown that Q-learning with linear function approximation is stable, in the sense of bounded parameter estimates, under the $(\epsilon ,\kappa )$-tamed Gibbs policy…