Regret of exploratory policy improvement and $q$-learning

Wenpin Tang, Xun Yu Zhou

We study the convergence of $q$-learning and related algorithms introduced by Jia and Zhou (J. Mach. Learn. Res., 24 (2023), 161) for controlled diffusion processes. For explorator…