Error Lower Bounds of Constant Step-size Stochastic Gradient Descent

Zhiyan Ding, Yiding Chen, Qin Li +1

Stochastic Gradient Descent (SGD) plays a central role in modern machine learning. While there is extensive work on providing error upper bound for SGD, not much is known about SGD…