Tracing Knowledge Lineage for Federated Unlearning under Mutual Distillation

Zihao Ding, Jun Huang, Guodong Wang

An edge server and nearby devices can train language models of different sizes together by mutual distillation. Federated unlearning (FU) and unlearning for large language models (…