4 papers · 1 filter
Distributed and Decentralized Optimization Algorithms via Consensus ALADIN
Xu Du, Jingzhe Wang, Karl H. Johansson +1
Distributed optimization has found widespread applications in smart grids, optimal control, and machine learning. This paper studies distributed consensus optimization. We extend t…
Stability of Low-Rank Implicit Regularization in Perturbed Deep Matrix Factorization
Jingzhe Wang, Hung-Hsu Chou
This paper studies the stability of low-rank implicit regularization in deep matrix factorization, a tractable model for understanding how gradient-based training can favor low-com…
A Bi-level Globalization Strategy for Non-convex Consensus ADMM and ALADIN
Xu Du, Jingzhe Wang, Xiaohua Zhou +1
In this paper, we formally analyze global convergence in the realm of distributed consensus optimization. Current solutions have explored such analysis, particularly focusing on co…
Consensus ALADIN: A Framework for Distributed Optimization and Its Application in Federated Learning
Xu Du, Jingzhe Wang
This paper investigates algorithms for solving distributed consensus optimization problems that are non-convex. Since Typical ALADIN (Typical Augmented Lagrangian based Alternating…