FedReFT: Federated Representation Fine-Tuning with All-But-Me Aggregation

Fatema Siddika, Md Anwar Hossen, J. Pablo Muñoz +3

Parameter-efficient fine-tuning (PEFT) adapts large pre-trained models by updating only a small subset of parameters. Recently, Representation Fine-Tuning (ReFT) has emerged as an…