10 citations · 17 across the 4 of their papers we have counts for
4 papers · 1 filter
A Flatness-Generalization Relation in the Teacher-Student Tree-Committee Machine
Brandon Livio Annesi, Davide Straziota, Enrico Maria Malatesta
The flatness of the loss landscape at a minimizer is a widely used heuristic for reasoning about neural-network generalization, yet evidence for this relation is mostly empirical a…
Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks
Brandon Livio Annesi, Dario Bocchi, Chiara Cammarota
High-dimensional non-convex loss landscapes play a central role in the theory of Machine Learning. Gaining insight into how these landscapes interact with gradient-based optimizati…
Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks
Brandon L. Annesi, Enrico M. Malatesta, Francesco Zamponi
We analyze the problem of storing random pattern-label associations using two classes of continuous non-convex weights models, namely the perceptron with negative margin and an inf…
The star-shaped space of solutions of the spherical negative perceptron
Brandon Livio Annesi, Clarissa Lauditi, Carlo Lucibello +4
Empirical studies on the landscape of neural networks have shown that low-energy configurations are often found in complex connected structures, where zero-energy paths between pai…