2 papers
stat.ML2026
On the Convergence Analysis of Muon
Wei Shen, Ruichuan Huang, Minhui Huang +2
The majority of parameters in neural networks are naturally represented as matrices. However, most commonly used optimizers treat these matrix parameters as flattened vectors durin…
math.OC2025
Stochastic Smoothed Primal-Dual Algorithms for Nonconvex Optimization with Linear Inequality Constraints
Ruichuan Huang, Jiawei Zhang, Ahmet Alacaoglu
We propose smoothed primal-dual algorithms for solving stochastic and smooth nonconvex optimization problems with linear inequality constraints. Our algorithms are single-loop and…