313 citations · 714 across the 53 of their papers we have counts for
Showing 2023 · math.OCShow all
2 papers · 2 filters
math.OC2023★ 7 cited
Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
Nachuan Xiao, Xiaoyin Hu, Xin Liu +1
In this paper, we present a comprehensive study on the convergence properties of Adam-family methods for nonsmooth optimization, especially in the training of nonsmooth neural netw…
math.OC2023
Smoothing Gradient Tracking for Decentralized Optimization over the Stiefel Manifold with Non-smooth Regularizers
Lei Wang, Xin Liu
Recently, decentralized optimization over the Stiefel manifold has attacked tremendous attentions due to its wide range of applications in various fields. Existing methods rely on…