Weak Convergence Analysis of Online Neural Actor-Critic Algorithms

Samuel Chun-Hei Lam, Justin Sirignano, Ziheng Wang

We prove that a single-layer neural network trained with the online actor critic algorithm converges in distribution to a random ordinary differential equation (ODE) as the number…