FastSGD: A Fast Compressed SGD Framework for Distributed Machine Learning

Keyu Yang, Lu Chen, Zhihao Zeng +1

With the rapid increase of big data, distributed Machine Learning (ML) has been widely applied in training large-scale models. Stochastic Gradient Descent (SGD) is arguably the wor…