Homomorphic Parameter Compression for Distributed Deep Learning Training

Jaehee Jang, Byungook Na, Sungroh Yoon

Distributed training of deep neural networks has received significant research interest, and its major approaches include implementations on multiple GPUs and clusters. Paralleliza…