313 citations · 714 across the 53 of their papers we have counts for
5 papers · 1 filter
Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
Nachuan Xiao, Xiaoyin Hu, Xin Liu +1
In this paper, we present a comprehensive study on the convergence properties of Adam-family methods for nonsmooth optimization, especially in the training of nonsmooth neural netw…
Smoothing Gradient Tracking for Decentralized Optimization over the Stiefel Manifold with Non-smooth Regularizers
Lei Wang, Xin Liu
Recently, decentralized optimization over the Stiefel manifold has attacked tremendous attentions due to its wide range of applications in various fields. Existing methods rely on…
A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
Lei Wang, Xin Liu
Decentralized optimization with orthogonality constraints is found widely in scientific computing and data science. Since the orthogonality constraints are nonconvex, it is quite c…
Decentralized Optimization Over the Stiefel Manifold by an Approximate Augmented Lagrangian Function
Lei Wang, Xin Liu
In this paper, we focus on the decentralized optimization problem over the Stiefel manifold, which is defined on a connected network of agents. The objective is an average of $…
Seeking Consensus on Subspaces in Federated Principal Component Analysis
Lei Wang, Xin Liu, Yin Zhang
In this paper, we develop an algorithm for federated principal component analysis (PCA) with emphases on both communication efficiency and data privacy. Generally speaking, federat…