1 citations · 1 across the 6 of their papers we have counts for
6 papers
Spectral phase transitions and trainability in neural network learning dynamics
Chanju Park, Dario Bocchi, Francesco D'Amico +2
The emergence of low-dimensional structures in the spectra of neural network weight matrices is a common empirical feature of trained models, but the dynamical origin of this pheno…
Benchmarking Graph Neural Networks in Solving Hard Constraint Satisfaction Problems
Geri Skenderi, Lorenzo Buffoni, Francesco D'Amico +6
Graph neural networks (GNNs) are increasingly applied to hard optimization problems, often claiming superiority over classical heuristics. However, such claims risk being unsolid d…
Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings
Francesco D'Amico, Dario Bocchi, Luca Maria Del Bono +2
Energy-based probabilistic models learned by maximizing the likelihood of the data are limited by the intractability of the partition function. A widely used workaround is to maxim…
Statistical mechanics of vector Hopfield network near and above saturation
Flavio Nicoletti, Francesco D'Amico, Matteo Negri
We study analytically and numerically a Hopfield fully-connected network with -dimensional vector spins. These networks are models of associative memory that generalize the stan…
Implicit bias produces neural scaling laws in learning curves, from perceptrons to deep networks
Francesco D'Amico, Dario Bocchi, Matteo Negri
Scaling laws in deep learning -- empirical power-law relationships linking model performance to resource growth -- have emerged as simple yet striking regularities across architect…
Self-attention as an attractor network: transient memories without backpropagation
Francesco D'Amico, Matteo Negri
Transformers are one of the most successful architectures of modern neural networks. At their core there is the so-called attention mechanism, which recently interested the physics…