Subspace-Constrained Federated Learning with Low-Rank Adaptation

Neranjan Senarath, Rohit Muralitharan, Sadia Asif

Federated low-rank adaptation methods are attractive for fine-tuning large models under communication and privacy constraints, but heterogeneous client data can induce geometric mi…