Showing cs.CRShow all
2 papers · 1 filter
cs.CR2026
From Bilinear to Linear: Differentially Private Federated LoRA via Low-Dimensional Parameterization
Lele Zheng, Ruijie Hu, Tao Zhang +2
Federated Low-Rank Adaptation (LoRA) provides an efficient solution for finetuning large language models across distributed and privacy-sensitive data. However, despite avoiding ra…
cs.CR2026
FedGSA: Geometry-Consistent Subspace Aggregation for Differentially Private Federated LoRA
Lele Zheng, Ruijie Hu, Tao Zhang +2
Low-Rank Adaptation (LoRA) enables communication-efficient federated fine-tuning of pretrained language models. However, integrating differential privacy (DP) into federated LoRA r…