4 papers
Hessian-Free Distributed Bilevel Optimization via Penalization with Time-Scale Separation
Youcheng Niu, Jinming Xu, Ying Sun +2
This paper considers a class of distributed bilevel optimization (DBO) problems with a coupled inner-level subproblem. Existing approaches typically rely on hypergradient estimatio…
Pareto-optimal Trade-offs Between Communication and Computation with Flexible Gradient Tracking
Yan Huang, Jinming Xu, Li Chai +2
This paper addresses distributed stochastic optimization problems under non-i.i.d. data, focusing on the inherent trade-offs between communication and computational efficiency. To…
Beyond Scaffold: A Unified Spatio-Temporal Gradient Tracking Method
Yan Huang, Jinming Xu, Jiming Chen +1
In distributed and federated learning algorithms, communication overhead is often reduced by performing multiple local updates between communication rounds. However, due to data he…
An Optimistic Gradient Tracking Method for Distributed Minimax Optimization
Yan Huang, Jinming Xu, Jiming Chen +1
This paper studies the distributed minimax optimization problem over networks. To enhance convergence performance, we propose a distributed optimistic gradient tracking method, ter…