activity
20232026
most citedAdAdaGrad: Adaptive Batch Size Schemes for Adaptive Gradient Methods

3 citations · 4 across the 7 of their papers we have counts for

collaborators
Showing math.OCShow all

1 paper · 1 filter

math.OC2026

Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition

Sayantan Choudhury, Xiaoran Cheng, Martin Takáč +2

Most first-order optimizers treat matrix-valued parameters as vectors, ignoring the intrinsic geometry of hidden-layer weights in neural networks. Muon addresses this mismatch by u…