Robust Federated Finetuning of Foundation Models via Alternating Minimization of LoRA

Shuangyi Chen, Yue Ju, Hardik Dalal +2

Parameter-Efficient Fine-Tuning (PEFT) has risen as an innovative training strategy that updates only a select few model parameters, significantly lowering both computational and m…