Showing stat.MLShow all
3 papers · 1 filter
stat.ML2026
Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
Jie Huang, Bruno Loureiro, Stefano Sarao Mannelli
We study the population loss landscape of two-layer ReLU networks of the form in a realisable teacher-student setting with Gaussian covaria…
stat.ML2026
The Interplay of Data Structure and Imbalance in the Learning Dynamics of Diffusion Models
Flavio Nicoletti, Chenxiao Ma, Enrico Ventura +2
Real-world datasets are inherently heterogeneous, yet how per-class structural differences and sampling imbalance shape the training dynamics of diffusion models-and potentially ex…
stat.ML2024
Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks
Stefano Sarao Mannelli, Yaraslau Ivashynka, Andrew Saxe +1
A wide range of empirical and theoretical works have shown that overparameterisation can amplify the performance of neural networks. According to the lottery ticket hypothesis, ove…