Local SGD Accelerates Convergence by Exploiting Second Order Information of the Loss Function

Linxuan Pan, Shenghui Song

With multiple iterations of updates, local statistical gradient descent (L-SGD) has been proven to be very effective in distributed machine learning schemes such as federated learn…