3 papers
stat.ML2025
Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
Jean Barbier, Francesco Camilli, Minh-Toan Nguyen +2
For four decades statistical physics has been providing a framework to analyse neural networks. A long-standing question remained on its capacity to tackle deep learning models cap…
stat.ML2025
Statistical mechanics of extensive-width Bayesian neural networks near interpolation
Jean Barbier, Francesco Camilli, Minh-Toan Nguyen +2
For three decades statistical mechanics has been providing a framework to analyse neural networks. However, the theoretically tractable models, e.g., perceptrons, random features m…
stat.ML2025
Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
Jean Barbier, Francesco Camilli, Minh-Toan Nguyen +2
We consider a teacher-student model of supervised learning with a fully-trained two-layer neural network whose width and input dimension are large and proportional. We prov…