Towards Communication-efficient Federated Learning via Sparse and Aligned Adaptive Optimization

Xiumei Deng, Jun Li, Kang Wei +6

Adaptive moment estimation (Adam), as a Stochastic Gradient Descent (SGD) variant, has gained widespread popularity in federated learning (FL) due to its fast convergence. However,…