How Edge of Stability Hinders SCAFFOLD in Federated Optimization

Anant Khandelwal, Michael Crawshaw, Mingrui Liu

In federated learning, it is well known that heterogeneous data can (in theory) slow down optimization, and much effort has been directed at designing optimization algorithms that…