11 papers
GPU-Accelerated Conic Quadratic Programming with Local Linear Convergence under Strict Complementarity
Hongpei Li, Yicheng Huang, Huikang Liu +2
We present PDHCG-CQP, a GPU-accelerated first-order solver for large-scale conic convex quadratic programming. PDHCG-CQP supports affine constraints and Cartesian products of nonne…
A Curvature-Aware Rank-Adaptive Distributed Augmented-Lagrangian Solver for Large-Scale SDPs
Hongpei Li, Huikang Liu, Dongdong Ge +1
We present CARDAL (Curvature-Aware Rank-Adaptive Distributed Augmented Lagrangian), a distributed multi-GPU solver for large-scale semidefinite programs (SDPs) based on a rank-adap…
D-PDLP: Scaling PDLP to Distributed Multi-GPU Systems
Hongpei Li, Yicheng Huang, Huikang Liu +2
We present a distributed framework of the Primal-Dual Hybrid Gradient (PDHG) algorithm for solving massive-scale linear programming (LP) problems. Although PDHG-based solvers demon…
PDHCG-II: An Enhanced Version of PDHCG for Large-Scale Convex QP
Hongpei Li, Yicheng Huang, Huikang Liu +2
Quadratic programming (QP) is a fundamental optimization model with wide-ranging applications in decision-making and machine learning, yet efficiently solving large-scale instances…
OptPipe: Memory- and Scheduling-Optimized Pipeline Parallelism for LLM Training
Hongpei Li, Han Zhang, Huikang Liu +2
Pipeline parallelism (PP) has become a standard technique for scaling large language model (LLM) training across multiple devices. However, despite recent progress in reducing memo…
PDHCG: A Scalable First-Order Method for Large-Scale Competitive Market Equilibrium Computation
Huikang Liu, Yicheng Huang, Hongpei Li +2
Large-scale competitive market equilibrium problems arise in a wide range of important applications, including economic decision-making and intelligent manufacturing. Traditional s…