Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models
arXiv:2505.22598 · doi:10.1103/s1rm-29zx
Abstract
Recent years have seen a rise in the application of machine learning techniques to aid the simulation of hard-to-sample systems that cannot be studied using traditional methods. Despite the introduction of many different architectures and procedures, a wide theoretical understanding is still lacking, with the risk of suboptimal implementations. As a first step to address this gap, we provide here a complete analytic study of the widely-used Sequential Tempering procedure applied to a shallow MADE architecture for the Curie-Weiss model. The contribution of this work is twofold: firstly, we give a description of the optimal weights and of the training under Gradient Descent optimization. Secondly, we compare what happens in Sequential Tempering with and without the addition of local Metropolis Monte Carlo steps. We are thus able to give theoretical predictions on the best procedure to apply in this case. This work establishes a clear theoretical basis for the integration of machine learning techniques into Monte Carlo sampling and optimization.
arXiv comment17 pages, 10 figures
References in corpus (27)
- Exchange Monte Carlo Method and Application to Spin Glass Simulations
- Solving the Quantum Many-Body Problem with Artificial Neural Networks
- Analytical Solution of the Off-Equilibrium Dynamics of a Long Range Spin-Glass Model
- A high-bias, low-variance introduction to Machine Learning for physicists
- Solving Statistical Mechanics Using Variational Autoregressive Networks
- A Cluster Monte Carlo Algorithm for 2-Dimensional Spin Glasses
- Efficient Cluster Algorithm for Spin Glasses in Any Space Dimension
- Population Annealing with Weighted Averages: A Monte Carlo Method for Rough Free Energy Landscapes
- On the cooling-schedule dependence of the dynamics of mean-field glasses
- Comparing Monte Carlo methods for finding ground states of Ising spin glasses: population annealing, simulated annealing and parallel tempering
- Boosting Monte Carlo simulations of spin glasses using autoregressive neural networks
- GPU accelerated population annealing algorithm
- Rethinking mean-field glassy dynamics and its relation with the energy landscape: the awkward case of the spherical mixed p-spin model
- A piecewise deterministic scaling limit of Lifted Metropolis-Hastings in the Curie-Weiss model
- The Computation of the Mean First Passage Times for Markov Chains
- Unveiling the structure of wide flat minima in neural networks
- Understanding population annealing Monte Carlo simulations
- Generative diffusion in very large dimensions
- Machine-learning-assisted Monte Carlo fails at sampling computationally hard problems
- Lee-Yang theory of the Curie-Weiss model and its rare fluctuations
- Hierarchical autoregressive neural networks for statistical systems
- Wavelet Conditional Renormalization Group
- The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems
- Policy-guided Monte Carlo on general state spaces: Application to glass-forming mixtures
- Sparse Autoregressive Neural Networks for Classical Spin Systems
- A Very Effective and Simple Diffusion Reconstruction for the Diluted Ising Model
- Nearest-Neighbours Neural Network architecture for efficient sampling of statistical physics models