Heterogeneous Federated Fine-Tuning with Parallel One-Rank Adaptation

Zikai Zhang, Rui Hu, Jiahao Xu

Large Language Models (LLMs) have demonstrated remarkable effectiveness in adapting to downstream tasks through fine-tuning. Federated Learning (FL) extends this capability by enab…