4 papers · 1 filter
Muon Is Theoretically Wrong For Convolutions, But Empirically Effective
Thibaut Boissin, Thomas Massena, Mathieu Serrurier +1
Muon, an optimizer known for its efficiency, has a clear interpretation for matrix-valued updates, but convolutional kernels are stored as four-dimensional tensors. Standard implem…
LiST: Lipschitz Scaling Training for Robust and Calibrated Neural Networks
Arthur Chiron, Franck Mamalet, Thomas Massena +2
While accuracy, robustness, and calibration are all essential for reliable neural networks, they are often studied separately; developing models that satisfy all three simultaneous…
Efficient Robust Conformal Prediction via Lipschitz-Bounded Networks
Thomas Massena, Léo andéol, Thibaut Boissin +4
Conformal Prediction (CP) has proven to be an effective post-hoc method for improving the trustworthiness of neural networks by providing prediction sets with finite-sample guarant…
DP-SGD Without Clipping: The Lipschitz Neural Network Way
Louis Bethune, Thomas Massena, Thibaut Boissin +6
State-of-the-art approaches for training Differentially Private (DP) Deep Neural Networks (DNN) face difficulties to estimate tight bounds on the sensitivity of the network's layer…