Adaptivity via a Parallel Architecture for Stochastic Gradient Methods

Bin Fu

We develop a parallel framework that assembles static gradient methods to achieve better adaptivity. A static gradient method, denoted by $\mathrm{GD}(x_0,T)$, takes as input an in…