An Information-theoretic Method for Collaborative Distributed Learning with Limited Communication

Xinyi Tong, Jian Xu, Shao-Lun Huang

In this paper, we study the information transmission problem under the distributed learning framework, where each worker node is merely permitted to transmit a $m$-dimensional stat…