14 citations · 23 across the 4 of their papers we have counts for
8 papers
CADA: Communication-Adaptive Distributed Adam
Tianyi Chen, Ziye Guo, Yuejiao Sun +1
Stochastic gradient descent (SGD) has taken the stage as the primary workhorse for large-scale machine learning. It is often used with its adaptive variants such as AdaGrad, Adam,…
Decentralized Learning with Lazy and Approximate Dual Gradients
Yanli Liu, Yuejiao Sun, Wotao Yin
This paper develops algorithms for decentralized machine learning over a network, where data are distributed, computation is localized, and communication is restricted between neig…
VAFL: a Method of Vertical Asynchronous Federated Learning
Tianyi Chen, Xiao Jin, Yuejiao Sun +1
Horizontal Federated learning (FL) handles multi-client data that share the same set of features, and vertical FL trains a better predictor that combine all the features from diffe…
LASG: Lazily Aggregated Stochastic Gradients for Communication-Efficient Distributed Learning
Tianyi Chen, Yuejiao Sun, Wotao Yin
This paper targets solving distributed machine learning problems such as federated learning in a communication-efficient fashion. A class of new stochastic gradient descent (SGD) a…
General Proximal Incremental Aggregated Gradient Algorithms: Better and Novel Results under General Scheme
Tao Sun, Yuejiao Sun, Dongsheng Li +1
The incremental aggregated gradient algorithm is popular in network optimization and machine learning research. However, the current convergence results require the objective funct…
Decentralized Markov Chain Gradient Descent
Tao Sun, Dongsheng Li
Decentralized stochastic gradient method emerges as a promising solution for solving large-scale machine learning problems. This paper studies the decentralized Markov chain gradie…