Stationary Behavior of Constant Stepsize SGD Type Algorithms: An Asymptotic Characterization

Zaiwei Chen, Shancong Mou, Siva Theja Maguluri

Stochastic approximation (SA) and stochastic gradient descent (SGD) algorithms are work-horses for modern machine learning algorithms. Their constant stepsize variants are preferre…