Accelerating Distributed Deep Learning using Lossless Homomorphic Compression

Haoyu Li, Yuchen Xu, Jiayi Chen +5

As deep neural networks (DNNs) grow in complexity and size, the resultant increase in communication overhead during distributed training has become a significant bottleneck, challe…