Improving Communication Efficiency of Federated Distillation via Accumulating Local Updates

Zhiyuan Wu, Sheng Sun, Yuwei Wang +3

As an emerging federated learning paradigm, federated distillation enables communication-efficient model training by transmitting only small-scale knowledge during the learning pro…