2 citations · 2 across the 6 of their papers we have counts for
3 papers · 1 filter
The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks
Gabriele Farné, Fabrizio Boncoraglio, Lenka Zdeborová
A key capability of modern neural networks is their capacity to simultaneously learn underlying rules and memorize specific facts or exceptions. Yet, theoretical understanding of t…
Inference in Spreading Processes with Neural-Network Priors
Davide Ghio, Fabrizio Boncoraglio, Lenka Zdeborová
Stochastic processes on graphs are a powerful tool for modelling complex dynamical systems such as epidemics. A recent line of work focused on the inference problem where one aims…
Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws
Fabrizio Boncoraglio, Vittorio Erba, Emanuele Troiani +3
Trained attention layers exhibit striking and reproducible spectral structure of the weights, including low-rank collapse, bulk deformation, and isolated spectral outliers, yet the…