On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes

Boao Kong, Hengrui Zhang, Kun Yuan

We study stochastic gradient descent (SGD) for composite optimization problems with $N$ sequential operators subject to perturbations in both the forward and backward passes. Unlik…