Federated LoRA with Sparse Communication

Kevin Kuo, Arian Raje, Kousik Rajesh +1

Low-rank adaptation (LoRA) is a natural method for finetuning in communication-constrained machine learning settings such as cross-device federated learning. Prior work that has st…