Learned Gradient Compression for Distributed Deep Learning

Lusine Abrahamyan, Yiming Chen, Giannis Bekoulis +1

Training deep neural networks on large datasets containing high-dimensional data requires a large amount of computation. A solution to this problem is data-parallel distributed tra…