FedSDR: Federated Self-Distillation with Rectification

Ziheng Ren, Zhanming Shen, Hao Wang +2

Federated fine-tuning of Large Language Models faces severe statistical heterogeneity. However, existing model-level defenses often overlook the root cause: intrinsic data distribu…