8 citations · 18 across the 16 of their papers we have counts for
5 papers · 1 filter
Stochastic Gradient Methods with Online Scaling
Wanyu Zhang, Wenzhi Gao, Yinyu Ye +1
This paper introduces Stochastic Online Scaled Gradient Methods (SOSGM), a generalization of the recently developed adaptive preconditioning framework in arXiv:2505.23081 and arXiv…
Operator Splitting Methods with Online Scaling
Wanyu Zhang, Wenzhi Gao, Madeleine Udell
This paper develops a principled framework for automatically tuning preconditioners in operator splitting methods, including forward-backward splitting, Douglas-Rachford splitting,…
Tight Nonasymptotic Local Convergence of Sinkhorn-Knopp
Wenzhi Gao, Zhaonan Qu, Yinyu Ye +1
We revisit the Sinkhorn-Knopp (SK) algorithm for the matrix scaling problem. Despite extensive literature on the global convergence of SK and its variants, its local linear converg…
Small Gradient Norm Regret for Online Convex Optimization
Wenzhi Gao, Chang He, Madeleine Udell
This paper introduces a new problem-dependent regret measure for online convex optimization with smooth losses. The notion, which we call the regret, depends on the cumul…
SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraints
Ya-Chi Chu, Alkiviades Boukas, Madeleine Udell
Neural networks are increasingly used as fast surrogate models across various domains, but unconstrained predictions can violate physical, operational, or safety requirements. We p…