9 papers · 1 filter
Optimal Parameter Design for DIGing on Minimizing Unweighted Sum of Squares
Qiuchen Tian, Li Chai, Jinming Xu
There is no general method for designing proper parameters to achieve faster convergence in distributed optimization algorithms. In this paper, we consider the distributed inexact…
Exact Worst-case Convergence Rates of Distributed Gradient Tracking Methods
Qiuchen Tian, Li Chai, Jinming Xu
Different from most existing literature in the analysis of distributed optimization algorithms that reports sufficient convergence conditions leading to a conservative convergence…
Adaptive Polyak Stepsize with Level-value Adjustment for Distributed Optimization
Chen Ouyang, Yongyang Xiong, Jinming Xu +2
Stepsize selection remains a critical challenge in the practical implementation of distributed optimization. Existing distributed algorithms often rely on restrictive prior knowled…
Heterogeneous Stochastic Momentum ADMM for Distributed Nonconvex Composite Optimization
Yangming Zhang, Yongyang Xiong, Jinming Xu +2
This paper investigates the distributed stochastic nonconvex and nonsmooth composite optimization problem. Existing stochastic typically rely on uniform step size strictly bounded…
Hessian-Free Distributed Bilevel Optimization via Penalization with Time-Scale Separation
Youcheng Niu, Jinming Xu, Ying Sun +2
This paper considers a class of distributed bilevel optimization (DBO) problems with a coupled inner-level subproblem. Existing approaches typically rely on hypergradient estimatio…
Pareto-optimal Trade-offs Between Communication and Computation with Flexible Gradient Tracking
Yan Huang, Jinming Xu, Li Chai +2
This paper addresses distributed stochastic optimization problems under non-i.i.d. data, focusing on the inherent trade-offs between communication and computational efficiency. To…