Improving Parameter-Efficient Federated Learning with Differentially Private Refactorization

Linh Tran, Ana Milanova, Stacy Patterson

Federated Learning (FL) with parameter-efficient fine-tuning, such as Low-Rank Adaptation (LoRA), enables scalable model training on distributed data. However, when combined with D…