On Gaussian approximation for entropy-regularized Q-learning with function approximation

Artemy Rubtsov, Rahul Singh, Eric Moulines +2

In this paper, we derive rates of convergence in the high-dimensional central limit theorem for Polyak--Ruppert averaged iterates generated by entropy-regularized asynchronous Q-le…