activity
20192025
most citedAdam-family Methods for Nonsmooth Optimization with Convergence Guarantees

7 citations · 10 across the 10 of their papers we have counts for

collaborators

11 papers

math.OC2025

Partial Envelope for Optimization Problem with Nonconvex Constraints

Xiaoyin Hu, Xin Liu, Kim-Chuan Toh +1

In this paper, we consider the nonlinear constrained optimization problem (NCP) with constraint set , where is a closed convex subset…

math.OC2025

A Hybrid Subgradient Method for Nonsmooth Nonconvex Bilevel Optimization

Nachuan Xiao, Xiaoyin Hu, Xin Liu +1

In this paper, we focus on the nonconvex-nonconvex bilevel optimization problem (BLO), where both upper-level and lower-level objectives are nonconvex, with the upper-level problem…

math.OC2024

A Minimization Approach for Minimax Optimization with Coupled Constraints

Xiaoyin Hu, Kim-Chuan Toh, Shiwei Wang +1

In this paper, we focus on the nonconvex-strongly-concave minimax optimization problem (MCC), where the inner maximization subproblem contains constraints that couple the primal va…

math.OC2024

Learning-rate-free Momentum SGD with Reshuffling Converges in Nonsmooth Nonconvex Optimization

Xiaoyin Hu, Nachuan Xiao, Xin Liu +1

In this paper, we propose a generalized framework for developing learning-rate-free momentum stochastic gradient descent (SGD) methods in the minimization of nonsmooth nonconvex fu…

math.OC2024

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization

Nachuan Xiao, Kuangyu Ding, Xiaoyin Hu +1

In this paper, we consider the minimization of a nonsmooth nonconvex objective function over a closed convex subset of , with additional nonsmoot…

math.OC2023★ 2 cited

Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimization

Nachuan Xiao, Xiaoyin Hu, Kim-Chuan Toh

In this paper, we focus on providing convergence guarantees for stochastic subgradient methods in minimizing nonsmooth nonconvex functions. We first investigate the global stabilit…

math.OC2023★ 7 cited

Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees

Nachuan Xiao, Xiaoyin Hu, Xin Liu +1

In this paper, we present a comprehensive study on the convergence properties of Adam-family methods for nonsmooth optimization, especially in the training of nonsmooth neural netw…

math.OC2022★ 1 cited

CDOpt: A Python Package for a Class of Riemannian Optimization

Nachuan Xiao, Xiaoyin Hu, Xin Liu +1

Optimization over the embedded submanifold defined by constraints has attracted much interest over the past few decades due to its wide applications in various areas. Pl…

math.OC2022

An Improved Unconstrained Approach for Bilevel Optimization

Xiaoyin Hu, Nachuan Xiao, Xin Liu +1

In this paper, we focus on the nonconvex-strongly-convex bilevel optimization problem (BLO). In this BLO, the objective function of the upper-level problem is nonconvex and possibl…

math.OC2022

A Constraint Dissolving Approach for Nonsmooth Optimization over the Stiefel Manifold

Xiaoyin Hu, Nachuan Xiao, Xin Liu +1

This paper focus on the minimization of a possibly nonsmooth objective function over the Stiefel manifold. The existing approaches either lack efficiency or can only tackle prox-fr…

cs.DS2019

A Fast Exact Algorithm for Airplane Refueling Problem

Jianshu Li, Xiaoyin Hu, Junjie Luo +1

We consider the airplane refueling problem, where we have a fleet of airplanes that can refuel each other. Each airplane is characterized by specific fuel tank volume and fuel cons…