5 papers · 1 filter
Stochastic optimization over expectation-formulated generalized Stiefel manifold
Linshuo Jiang, Nachuan Xiao, Xin Liu
In this paper, we consider a class of stochastic optimization problems over the expectation-formulated generalized Stiefel manifold (SOEGS), where the objective function is con…
A Double Tracking Method for Optimization with Decentralized Generalized Orthogonality Constraints
Lei Wang, Nachuan Xiao, Xin Liu
In this paper, we consider the decentralized optimization problems with generalized orthogonality constraints, where both the objective function and the constraint exhibit a distri…
Learning-rate-free Momentum SGD with Reshuffling Converges in Nonsmooth Nonconvex Optimization
Xiaoyin Hu, Nachuan Xiao, Xin Liu +1
In this paper, we propose a generalized framework for developing learning-rate-free momentum stochastic gradient descent (SGD) methods in the minimization of nonsmooth nonconvex fu…
Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functions
Siyuan Zhang, Nachuan Xiao, Xin Liu
In this paper, we focus on the decentralized stochastic subgradient-based methods in minimizing nonsmooth nonconvex functions without Clarke regularity, especially in the decentral…
An Inexact Preconditioned Zeroth-order Proximal Method for Composite Optimization
Shanglin Liu, Lei Wang, Nachuan Xiao +1
In this paper, we consider the composite optimization problem, where the objective function integrates a continuously differentiable loss function with a nonsmooth regularization t…