4 papers · 1 filter
Muon Is Theoretically Wrong For Convolutions, But Empirically Effective
Thibaut Boissin, Thomas Massena, Mathieu Serrurier +1
Muon, an optimizer known for its efficiency, has a clear interpretation for matrix-valued updates, but convolutional kernels are stored as four-dimensional tensors. Standard implem…
LiST: Lipschitz Scaling Training for Robust and Calibrated Neural Networks
Arthur Chiron, Franck Mamalet, Thomas Massena +2
While accuracy, robustness, and calibration are all essential for reliable neural networks, they are often studied separately; developing models that satisfy all three simultaneous…
LipSSD: Lipschitz-Constrained Single-Shot Detection for Adversarially Robust Object Detection
Vincent Lébé, Yannick Prudent, Corentin Friedrich +3
Object detectors have many applications in safety-critical systems, but they are known to be sensitive to worst-case perturbations such as adversarial attacks, which limits their a…
From SGD to Muon: Adaptive Optimization via Schatten-p Norms
Thomas Massena, Corentin Friedrich, Mathieu Serrurier
Modern optimizers, like Muon, impose matrix-wise geometry constraints on their updates. These matrix-wise constraints can be unified under Linear Minimization Oracle (LMO) theory.…