17 citations · 26 across the 16 of their papers we have counts for
Showing math.OCShow all
2 papers · 1 filter
math.OC2025
Riemannian EXTRA: Communication-efficient decentralized optimization over compact submanifolds with data heterogeneity
Jiayuan Wu, Zhanwang Deng, Jiang Hu +2
We consider decentralized optimization over a compact Riemannian submanifold in a network of agents, where each agent holds a smooth, nonconvex local objective defined by its p…
math.OC2025
PolarGrad: A Class of Matrix-Gradient Optimizers from a Unifying Preconditioning Perspective
Tim Tsz-Kit Lau, Qi Long, Weijie Su
The ever-growing scale of deep learning models and training data underscores the critical importance of efficient optimization methods. While preconditioned gradient methods such a…