5 papers
MuonIO: Principled Norm-Aware Descent for Embedding Tables and Language Model Heads
Linkai Ma, Xinyu Luo, Mengbo Wang +3
The Muon optimizer derives its update rule for hidden linear layers by solving a local linearization of the loss penalized by the spectral norm, motivated by an RMS-stability argum…
Certified Approximation for Interpretable Representer Landmarks
Jayanta Mukherjee, Shourya Verma, Mengbo Wang +2
Representer explanations rank the training landmarks that most influence a self-supervised representation. At scale, this ranking rests on up to four stacked approximations of the…
GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow
Mengbo Wang, Shourya Verma, Aditya Malusare +6
Spatial transcriptomics (ST) technologies can be used to align transcriptomes with histopathological morphology, presenting exciting new opportunities for biomolecular discovery. U…
RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation
Shourya Verma, Mengbo Wang, Nadia Atallah Lanman +1
Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distil…
BAGEL: Adversarially Constrained Online Convex Optimization under Separation Oracle Access
Yiyang Lu, Mohammad Pedramfar, Mengbo Wang +1
In adversarial Constrained Online Convex Optimization (COCO), a learner selects actions from a fixed convex set while seeking both low regret and low cumulative constraint violatio…