9 papers
Zeroth-Order primal-dual Alternating Projection Gradient Algorithms for Nonconvex Minimax Problems with Coupled linear Constraints
Huiling Zhang, Zi Xu, Yuhong Dai
In this paper, we study zeroth-order algorithms for nonconvex minimax problems with coupled linear constraints under the deterministic and stochastic settings, which have attracted…
A Homogeneous Second-Order Descent Ascent Algorithm for Nonconvex-Strongly Concave Minimax Problems
Jia-Hao Chen, Zi Xu, Hui-Ling Zhang
This paper introduces a novel Homogeneous Second-order Descent Ascent (HSDA) algorithm for nonconvex-strongly concave minimax optimization problems. At each iteration, HSDA uniquel…
Restart-Free (Accelerated) Gradient Sliding Methods for Strongly Convex Composite Optimization
Xinming Wu, Zi Xu, Huiling Zhang
In this paper, we study a class of composite optimization problems whose objective function is given by the summation of a general smooth and nonsmooth component, together with a r…
BEACON: Bayesian Optimal Stopping for Efficient LLM Sampling
Guangya Wan, Zixin Stephen Xu, Sasa Zorc +4
Sampling multiple responses is a common way to improve LLM output quality, but it comes at the cost of additional computation. The key challenge is deciding when to stop generating…
A Fully Parameter-Free Second-Order Algorithm for Convex-Concave Minimax Problems
Junlin Wang, Zi Xu, Huiling Zhang
In this paper, we study second-order algorithms for the convex-concave minimax problem, which has attracted much attention in many fields such as machine learning in recent years.…
Completely Parameter-Free Single-Loop Algorithms for Nonconvex-Concave Minimax Problems
Junnan Yang, Huiling Zhang, Zi Xu
Due to their importance in various emerging applications, efficient algorithms for solving minimax problems have recently received increasing attention. However, many existing algo…