Federated Knowledge Distillation

Hyowoon Seo, Jihong Park, Seungeun Oh +2

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges…