Adaptive Parameter-Efficient Federated Fine-Tuning on Heterogeneous Devices

Jun Liu, Yunming Liao, Hongli Xu +3

Federated fine-tuning (FedFT) has been proposed to fine-tune the pre-trained language models in a distributed manner. However, there are two critical challenges for efficient FedFT…