6 papers
Memorisation, convergence and generalisation in generative models
Antoine Maillard, Sebastian Goldt
Generative neural networks learn how to produce highly realistic images from a large, but finite number of examples - or do they simply memorise their training set? To settle this…
Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
Alessio Giorlandino, Sebastian Goldt, Antoine Maillard
Large language models demonstrate remarkable ability in factual recall, yet the fundamental limits of storing and retrieving input--output associations with neural networks remain…
A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models
Leonardo Defilippis, Florent Krzakala, Bruno Loureiro +1
Understanding when learning is statistically possible yet computationally hard is a central challenge in high-dimensional statistics. In this work, we investigate this question in…
Average-case matrix discrepancy: satisfiability bounds
Antoine Maillard
Given a sequence of symmetric matrices , and a margin , we investigate whether it is possible to find signs $(ε_1, \dots, ε_n) \in \…
Exact threshold for approximate ellipsoid fitting of random points
Afonso S. Bandeira, Antoine Maillard
We consider the problem of exactly fitting an ellipsoid (centered at ) to standard Gaussian random vectors in , as with $n / d^2 \t…
Randomstrasse101: Open Problems of 2024
Afonso S. Bandeira, Anastasia Kireeva, Antoine Maillard +1
is a blog dedicated to Open Problems in Mathematics, with a focus on Probability Theory, Computation, Combinatorics, Statistics, and related topics. Thi…