Stochastic Gradient Descent: A Nonlinear Time Series Perspective

Jiaqi Li, Zhipeng Lou, Stefan Richter +1

This paper investigates the statistical behavior of Stochastic Gradient Descent (SGD) with constant step size under the framework of iterated random functions. Compared to previous…