33 citations · 101 across the 19 of their papers we have counts for
4 papers · 1 filter
High-Dimensional Asymptotics and Dataset Selection for Private Transfer Learning
Filip Kovačević, Edwige Cyffers, Stefano Sarao Mannelli +1
To commit to buying external data or participate in collaborative learning, one must decide whether the additional data will improve prediction enough to justify the cost. This com…
Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
Jie Huang, Bruno Loureiro, Stefano Sarao Mannelli
We study the population loss landscape of two-layer ReLU networks of the form in a realisable teacher-student setting with Gaussian covaria…
The Interplay of Data Structure and Imbalance in the Learning Dynamics of Diffusion Models
Flavio Nicoletti, Chenxiao Ma, Enrico Ventura +2
Real-world datasets are inherently heterogeneous, yet how per-class structural differences and sampling imbalance shape the training dynamics of diffusion models-and potentially ex…
Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node Activation
Sebastian Lee, Stefano Sarao Mannelli, Claudia Clopath +2
Continual learning - learning new tasks in sequence while maintaining performance on old tasks - remains particularly challenging for artificial neural networks. Surprisingly, the…