A Diffusion Analysis of Policy Gradient for Stochastic Bandits

Tor Lattimore

We study a continuous-time diffusion approximation of policy gradient for $k$-armed stochastic bandits. We prove that with a learning rate $\hat{I}\cdot =O(\hat{I}{”}^2/\log (n))$ the regret is $O(k…