2 papers
cond-mat.dis-nn2026
Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks
Dario Bocchi, Theotime Regimbeau, Carlo Lucibello +2
We analyze the one-pass stochastic gradient descent dynamics of a two-layer neural network with quadratic activations in a teacher--student framework. In the high-dimensional regim…
cond-mat.dis-nn2025
Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks
Brandon Livio Annesi, Dario Bocchi, Chiara Cammarota
High-dimensional non-convex loss landscapes play a central role in the theory of Machine Learning. Gaining insight into how these landscapes interact with gradient-based optimizati…