Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
MuonIO: Principled Norm-Aware Descent for Embedding Tables and Language Model Heads
Linkai Ma, Xinyu Luo, Mengbo Wang +3
The Muon optimizer derives its update rule for hidden linear layers by solving a local linearization of the loss penalized by the spectral norm, motivated by an RMS-stability argum…
cs.LG2026
Certified Approximation for Interpretable Representer Landmarks
Jayanta Mukherjee, Shourya Verma, Mengbo Wang +2
Representer explanations rank the training landmarks that most influence a self-supervised representation. At scale, this ranking rests on up to four stacked approximations of the…
cs.LG2025
BAGEL: Adversarially Constrained Online Convex Optimization under Separation Oracle Access
Yiyang Lu, Mohammad Pedramfar, Mengbo Wang +1
In adversarial Constrained Online Convex Optimization (COCO), a learner selects actions from a fixed convex set while seeking both low regret and low cumulative constraint violatio…