Central limit theorem for the averaged Adam optimizer

Steffen Dereich, Arnulf Jentzen

In this article, we analyse convergence of the averaged Adam optimizer to an attracting zero of the Adam vector field. We provide a central limit theorem that, in particular, quant…