1 paper · 1 filter
Wenpeng Zhang, Runsheng Yu
While NorMuon has achieved strong empirical performance in pretraining, its underlying adaptive mechanism remains largely heuristic and poorly understood. In this work, we provide…