4 papers
Discontinuous BBP transitions
Dario Bocchi, Giulio Biroli, Chiara Cammarota +1
The Baik-Ben Arous-Peche (BBP) transition sets fundamental limits for detecting low-rank structure in noisy high-dimensional data and underlies a wide range of spectral methods in…
Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks
Dario Bocchi, Theotime Regimbeau, Carlo Lucibello +2
We analyze the one-pass stochastic gradient descent dynamics of a two-layer neural network with quadratic activations in a teacher--student framework. In the high-dimensional regim…
Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks
Brandon Livio Annesi, Dario Bocchi, Chiara Cammarota
High-dimensional non-convex loss landscapes play a central role in the theory of Machine Learning. Gaining insight into how these landscapes interact with gradient-based optimizati…
Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings
Francesco D'Amico, Dario Bocchi, Luca Maria Del Bono +2
Energy-based probabilistic models learned by maximizing the likelihood of the data are limited by the intractability of the partition function. A widely used workaround is to maxim…