MQGrad: Reinforcement Learning of Gradient Quantization in Parameter Server

Guoxin Cui, Jun Xu, Wei Zeng +3

One of the most significant bottleneck in training large scale machine learning models on parameter server (PS) is the communication overhead, because it needs to frequently exchan…