Revisiting the central limit theorems for the SGD-type methods

Tiejun Li, Tiannan Xiao, Guoguo Yang

We revisited the central limit theorem (CLT) for stochastic gradient descent (SGD) type methods, including the vanilla SGD, momentum SGD and Nesterov accelerated SGD methods with c…