8 citations · 8 across the 8 of their papers we have counts for
3 papers · 1 filter
Spectral phase transitions and trainability in neural network learning dynamics
Chanju Park, Dario Bocchi, Francesco D'Amico +2
The emergence of low-dimensional structures in the spectra of neural network weight matrices is a common empirical feature of trained models, but the dynamical origin of this pheno…
Discontinuous BBP transitions
Dario Bocchi, Giulio Biroli, Chiara Cammarota +1
The Baik-Ben Arous-Peche (BBP) transition sets fundamental limits for detecting low-rank structure in noisy high-dimensional data and underlies a wide range of spectral methods in…
Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks
Dario Bocchi, Theotime Regimbeau, Carlo Lucibello +2
We analyze the one-pass stochastic gradient descent dynamics of a two-layer neural network with quadratic activations in a teacher--student framework. In the high-dimensional regim…