A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration

Yuchen Hu, Xi Chen, Weidong Liu +1

Distributed stochastic optimization algorithms can simultaneously process large-scale datasets, significantly accelerating model training. However, their effectiveness is often hin…