Trustworthiness of Stochastic Gradient Descent in Distributed Learning

Hongyang Li, Caesar Wu, Mohammed Chadli +2

Distributed learning (DL) uses multiple nodes to accelerate training, enabling efficient optimization of large-scale models. Stochastic Gradient Descent (SGD), a key optimization a…