FedGSA: Geometry-Consistent Subspace Aggregation for Differentially Private Federated LoRA

Lele Zheng, Ruijie Hu, Tao Zhang +2

Low-Rank Adaptation (LoRA) enables communication-efficient federated fine-tuning of pretrained language models. However, integrating differential privacy (DP) into federated LoRA r…