Painless Federated Learning: An Interplay of Line-Search and Extrapolation

Geetika, Somya Tyagi, Bapi Chatterjee

The classical line search for learning rate (LR) tuning in the stochastic gradient descent (SGD) algorithm can tame the convergence slowdown due to data-sampling noise. In a federa…