Adaptive Federated Distillation for Multi-Domain Non-IID Textual Data

Jiahao Xiao, Jiangming Liu

The widespread success of pre-trained language models has established a new training paradigm, where a global PLM is fine-tuned using task-specific data from local clients. The loc…