Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignment

Hongyi Peng, Han Yu, Xiaoxiao Li +1

Low-Rank Adaptation (LoRA) is widely used for federated fine-tuning. Yet under non-IID settings, it can substantially underperform full-parameter fine-tuning. Through with-high-pro…