3 papers
cond-mat.dis-nn2026
Sampling at intermediate temperatures is optimal for training large language models in protein structure prediction
L. Ghiringhelli, A. Zambon, G. Tiana
We investigate the parameter space of transformer models trained on protein sequence data using a statistical mechanics framework, sampling the loss landscape at varying temperatur…
cond-mat.dis-nn2026
Controlled Langevin Dynamics for Sampling of Feedforward Neural Networks Trained with Minibatches
Alessandro Zambon, Francesca Caruso, Riccardo Zecchina +1
Sampling the parameter space of artificial neural networks according to a Boltzmann distribution provides insight into the geometry of low-loss solutions and offers an alternative…
cond-mat.dis-nn2025
Sampling the space of solutions of an artificial neural network
Alessandro Zambon, Enrico M. Malatesta, Guido Tiana +1
The weight space of an artificial neural network can be systematically explored using tools from statistical mechanics. We employ a combination of a hybrid Monte Carlo algorithm wh…