Flattened one-bit stochastic gradient descent: compressed distributed optimization with controlled variance

Alexander Stollenwerk, Laurent Jacques

We propose a novel algorithm for distributed stochastic gradient descent (SGD) with compressed gradient communication in the parameter-server framework. Our gradient compression te…