4 papers
Beyond Scaffold: A Unified Spatio-Temporal Gradient Tracking Method
Yan Huang, Jinming Xu, Jiming Chen +1
In distributed and federated learning algorithms, communication overhead is often reduced by performing multiple local updates between communication rounds. However, due to data he…
Pareto-optimal Trade-offs Between Communication and Computation with Flexible Gradient Tracking
Yan Huang, Jinming Xu, Li Chai +2
This paper addresses distributed stochastic optimization problems under non-i.i.d. data, focusing on the inherent trade-offs between communication and computational efficiency. To…
An Optimistic Gradient Tracking Method for Distributed Minimax Optimization
Yan Huang, Jinming Xu, Jiming Chen +1
This paper studies the distributed minimax optimization problem over networks. To enhance convergence performance, we propose a distributed optimistic gradient tracking method, ter…
Hessian-Free Distributed Bilevel Optimization via Penalization with Time-Scale Separation
Youcheng Niu, Jinming Xu, Ying Sun +2
This paper considers a class of distributed bilevel optimization (DBO) problems with a coupled inner-level subproblem. Existing approaches typically rely on hypergradient estimatio…