183 citations · 474 across the 30 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
The Row Normalization Puzzle in Muon
Jiayu Zhang, Tianyi Lin
This paper examines how row-wise renormalization affects Muon, focusing on the gap between NorMuon's worst-case guarantees and its practical performance (Li et al.). Despite its gr…
math.OC2026
Tight Complexity of Muon under Heavy-Tailed Noise
Jiayu Zhang, Tianyi Lin
A growing lesson from neural network optimization is that optimizer design should respect how the model is parametrized. The layerwise input-output structure of neural networks mot…