How Much Regularization Survives Averaging? Update Masking in Federated Learning

Wenhao Yan, Fu Kuroda, Yucheng Jin +1

Federated learning on non-IID data seeks flat minima to generalize across clients, and existing methods borrow sharpness-aware minimization from centralized training. There is a se…