9 papers
Sharp Initialization Guarantees for the Heavy-Ball Method
Kang Liu, Quanen Wu, Zhan Sun +3
The heavy-ball method can accelerate convergence near the minimizer, but it may also enter persistent oscillations on general strongly convex objectives. How should it be initializ…
Equilibrium bias and convergence in augmented primal--dual dynamics with sampled constraints
Kang Liu, Mengxiao Chen, Siqi Xiong +1
This work studies the stability and convergence of augmented primal-dual dynamics when constraint values are estimated from samples. Unbiased constraint observations can produce a…
Residual-Controlled Douglas--Rachford Splitting for Differentiable Solver Layers
Kang Liu, Jianchen Hu
Differentiable solver layers embed constrained optimization into end-to-end learning systems, but fixed-depth unrolling must trade off solution quality, feasibility, and computatio…
Residual-Controlled Multiplier Learning for Stochastic Constrained Decision-Making
Kang Liu, Jianchen Hu, Ziyu Qu +3
Stochastic constrained decision-making requires optimizing performance objectives while enforcing statistical requirements such as safety or fairness. However, standard primal--dua…
SOC-ICNN: From Polyhedral to Conic Geometry for Learning Convex Surrogate Functions
Kang Liu, Jianchen Hu, Wei Peng
Classical ReLU-based Input Convex Neural Networks (ICNNs) are equivalent to the optimal value functions of Linear Programming (LP). This intrinsic structural equivalence restricts…
OPBO: Order-Preserving Bayesian Optimization
Wei Peng, Jianchen Hu, Kang Liu +1
Bayesian optimization is an effective method for solving expensive black-box optimization problems. Most existing methods use Gaussian processes (GP) as the surrogate model for app…
Biomed-DPT: Dual Modality Prompt Tuning for Biomedical Vision-Language Models
Wei Peng, Kang Liu, Jianchen Hu +1
Prompt learning is one of the most effective paradigms for adapting pre-trained vision-language models (VLMs) to the biomedical image classification tasks in few shot scenarios. Ho…
Learning based convex approximation for constrained parametric optimization
Kang Liu, Wei Peng, Jianchen Hu
We propose an input convex neural network (ICNN)-based self-supervised learning framework to solve continuous constrained optimization problems. By integrating the augmented Lagran…
EEG-DCNet: A Fast and Accurate MI-EEG Dilated CNN Classification Method
Wei Peng, Kang Liu, Jiaxi Shi +1
The electroencephalography (EEG)-based motor imagery (MI) classification is a critical and challenging task in brain-computer interface (BCI) technology, which plays a significant…