2 papers
cs.LG2026
Federated Lightweight Fine-Tuning
Radhakrishna Achanta, Will Reed
Federated fine-tuning is bottlenecked by communication: FedAvg and pseudo-gradient schemes transmit a payload that scales with the model, and gradient compression shrinks it by onl…
cs.LG2026
TallyTrain: Communication-Efficient Federated Distillation
Radhakrishna Achanta, Will Reed
Federated learning is bandwidth-bound on two orthogonal axes: model size, which limits how often parameter-averaging methods can afford to merge, and class count, which makes per-p…