Simple and optimal high-probability bounds for strongly-convex stochastic gradient descent

Nicholas J. A. Harvey, Christopher Liaw, Sikander Randhawa

We consider stochastic gradient descent algorithms for minimizing a non-smooth, strongly-convex function. Several forms of this algorithm, including suffix averaging, are known to…