Convergence Rate for the Last Iterate of Stochastic Gradient Descent Schemes

Marcel Hudiani

We study the convergence rate for the last iterate of stochastic gradient descent (SGD) and stochastic heavy ball (SHB) in the parametric setting when the objective function $F$ is…