65 citations · 160 across the 14 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2022
Federated Learning with Privacy-Preserving Ensemble Attention Distillation
Xuan Gong, Liangchen Song, Rishi Vedula +8
Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particula…
cs.LG2021★ 44 cited
Rethinking Soft Labels for Knowledge Distillation: A Bias-Variance Tradeoff Perspective
Helong Zhou, Liangchen Song, Jiajie Chen +4
Knowledge distillation is an effective approach to leverage a well-trained network or an ensemble of them, named as the teacher, to guide the training of a student network. The out…