203 citations · 593 across the 26 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.DC2017
Asynchronous COMID: the theoretic basis for transmitted data sparsification tricks on Parameter Server
Daning Cheng, Shigang Li, Yunquan Zhang
Asynchronous FTRL-proximal and L2 norm done at server are two widely used tricks in Parameters Server which is an implement of delayed SGD. Their commonness is leaving parts of upd…
cs.LG2017★ 1 cited
Weighted parallel SGD for distributed unbalanced-workload training system
Cheng Daning, Li Shigang, Zhang Yunquan
Stochastic gradient descent (SGD) is a popular stochastic optimization method in machine learning. Traditional parallel SGD algorithms, e.g., SimuParallel SGD, often require all no…