An Adaptive Remote Stochastic Gradient Method for Training Neural Networks

Yushu Chen, Hao Jing, Wenlai Zhao +5

We present the remote stochastic gradient (RSG) method, which computes the gradients at configurable remote observation points, in order to improve the convergence rate and suppres…