Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework

Siyuan Yu, Wei Chen, H. Vincent Poor

Distributed stochastic gradient descent (SGD) has attracted considerable recent attention due to its potential for scaling computational resources, reducing training time, and help…