Convergence diagnostics for stochastic gradient descent with constant step size

Jerry Chee, Panos Toulis

Many iterative procedures in stochastic optimization exhibit a transient phase followed by a stationary phase. During the transient phase the procedure converges towards a region o…