3 papers
cs.LG2026
Support Before Frequency in Discrete Diffusion
Adrian Müller, Antoine Gonon, Zebang Shen +2
Discrete diffusion models are increasingly competitive for language modeling, yet it remains unclear how their denoising objectives organize learning. Although these objectives tar…
math.OC2026
Insights on Muon from Simple Quadratics
Antoine Gonon, Andreea-Alexandra MuÅat, Nicolas Boumal
Muon updates weight matrices along (approximate) polar factors of the gradients and has shown strong empirical performance in large-scale training. Existing attempts at explaining…
cs.LG2026
Gaussian Match-and-Copy: A Minimalist Benchmark for Studying Transformer Induction
Antoine Gonon, Alexandre Cordonnier, Nicolas Boumal
Match-and-copy is a core retrieval primitive used at inference time by large language models to retrieve a matching token from the context then copy its successor. Yet, understandi…