Hierarchical autoregressive neural networks in three-dimensional statistical system

Abstract

Autoregressive Neural Networks (ANN) have been recently proposed as a mechanism to improve the efficiency of Monte Carlo algorithms for several spin systems. The idea relies on the fact that the total probability of a configuration can be factorized into conditional probabilities of each spin, which in turn can be approximated by a neural network. Once trained, the ANNs can be used to sample configurations from the approximated probability distribution and to explicitly evaluate this probability for a given configuration. It has also been observed that such conditional probabilities give access to information-theoretic observables such as mutual information or entanglement entropy. In this paper, we describe the hierarchical autoregressive network (HAN) algorithm in three spatial dimensions and study its performance using the example of the Ising model. We compare HAN with three other autoregressive architectures and the classical Wolff cluster algorithm. Finally, we provide estimates of thermodynamic observables for the three-dimensional Ising model, such as entropy and free energy, in a range of temperatures across the phase transition.

19 pages, 8 figures

References in corpus (10)

• An efficient, multiple range random walk algorithm to calculate the density of states
• Solving Statistical Mechanics Using Variational Autoregressive Networks
• Flow-based generative models for Markov chain Monte Carlo in lattice field theory
• Estimation of Thermodynamic Observables in Lattice Field Theories with Deep Generative Models
• Asymptotically unbiased estimation of physical observables with neural samplers
• Efficient Modelling of Trivializing Maps for Lattice ${\varphi }^4$ Theory Using Normalizing Flows: A First Look at Scalability
• Entanglement entropy from non-equilibrium Monte Carlo simulations
• Hierarchical autoregressive neural networks for statistical systems
• The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems
• Rényi entanglement entropy of spin chain with Generative Neural Networks