11 papers
GPU-Accelerated Conic Quadratic Programming with Local Linear Convergence under Strict Complementarity
Hongpei Li, Yicheng Huang, Huikang Liu +2
We present PDHCG-CQP, a GPU-accelerated first-order solver for large-scale conic convex quadratic programming. PDHCG-CQP supports affine constraints and Cartesian products of nonne…
A Curvature-Aware Rank-Adaptive Distributed Augmented-Lagrangian Solver for Large-Scale SDPs
Hongpei Li, Huikang Liu, Dongdong Ge +1
We present CARDAL (Curvature-Aware Rank-Adaptive Distributed Augmented Lagrangian), a distributed multi-GPU solver for large-scale semidefinite programs (SDPs) based on a rank-adap…
PDHCG-II: An Enhanced Version of PDHCG for Large-Scale Convex QP
Hongpei Li, Yicheng Huang, Huikang Liu +2
Quadratic programming (QP) is a fundamental optimization model with wide-ranging applications in decision-making and machine learning, yet efficiently solving large-scale instances…
D-PDLP: Scaling PDLP to Distributed Multi-GPU Systems
Hongpei Li, Yicheng Huang, Huikang Liu +2
We present a distributed framework of the Primal-Dual Hybrid Gradient (PDHG) algorithm for solving massive-scale linear programming (LP) problems. Although PDHG-based solvers demon…
OptPipe: Memory- and Scheduling-Optimized Pipeline Parallelism for LLM Training
Hongpei Li, Han Zhang, Huikang Liu +2
Pipeline parallelism (PP) has become a standard technique for scaling large language model (LLM) training across multiple devices. However, despite recent progress in reducing memo…
PDHCG: A Scalable First-Order Method for Large-Scale Competitive Market Equilibrium Computation
Huikang Liu, Yicheng Huang, Hongpei Li +2
Large-scale competitive market equilibrium problems arise in a wide range of important applications, including economic decision-making and intelligent manufacturing. Traditional s…
When Does Primal Interior Point Method Beat Primal-dual in Linear Optimization?
Wenzhi Gao, Huikang Liu, Yinyu Ye +1
The primal-dual interior point method (IPM) is widely regarded as the most efficient IPM variant for linear optimization. In this paper, we demonstrate that the improved stability…
Orientation Determination of Cryo-EM Images Using Block Stochastic Riemannian Subgradient Methods
Wanyu Zhang, Ruili Gou, Huikang Liu +2
The determination of molecular orientations is crucial for the three-dimensional reconstruction of Cryo-EM images. Traditionally addressed using the common-line method, this challe…
A Robust Anchor-based Method for Multi-Camera Pedestrian Localization
Wanyu Zhang, Jiaqi Zhang, Dongdong Ge +4
This paper addresses the problem of vision-based pedestrian localization, which estimates a pedestrian's location using images and camera parameters. In practice, however, calibrat…
Restarted Primal-Dual Hybrid Conjugate Gradient Method for Large-Scale Quadratic Programming
Yicheng Huang, Wanyu Zhang, Hongpei Li +3
Convex quadratic programming (QP) is an essential class of optimization problems with broad applications across various fields. Traditional QP solvers, typically based on simplex o…
A Low-Rank ADMM Splitting Approach for Semidefinite Programming
Qiushi Han, Chenxi Li, Zhenwei Lin +5
We introduce a new first-order method for solving general semidefinite programming problems, based on the alternating direction method of multipliers (ADMM) and a matrix-splitting…