Sparse-SignSGD with Majority Vote for Communication-Efficient Distributed Learning

Chanho Park, Namyoon Lee

The training efficiency of complex deep learning models can be significantly improved through the use of distributed optimization. However, this process is often hindered by a larg…