Analysis of autocorrelation times in Neural Markov Chain Monte Carlo simulations

Abstract

We provide a deepened study of autocorrelations in Neural Markov Chain Monte Carlo (NMCMC) simulations, a version of the traditional Metropolis algorithm which employs neural networks to provide independent proposals. We illustrate our ideas using the two-dimensional Ising model. We discuss several estimates of autocorrelation times in the context of NMCMC, some inspired by analytical results derived for the Metropolized Independent Sampler (MIS). We check their reliability by estimating them on a small system where analytical results can also be obtained. Based on the analytical results for MIS we propose a new loss function and study its impact on the autocorelation times. Although, this function's performance is a bit inferior to the traditional Kullback-Leibler divergence, it offers two training algorithms which in some situations may be beneficial. By studying a small, $4\times 4$, system we gain access to the dynamics of the training process which we visualize using several observables. Furthermore, we quantitatively investigate the impact of imposing global discrete symmetries of the system in the neural network training process on the autocorrelation times. Eventually, we propose a scheme which incorporates partial heat-bath updates which considerably improves the quality of the training. The impact of the above enhancements is discussed for a $16\times 16$ spin system. The summary of our findings may serve as a guidance to the implementation of Neural Markov Chain Monte Carlo simulations for more complicated models.

20 pages, 11 figures

References in corpus (5)

• Accelerate Monte Carlo Simulations with Restricted Boltzmann Machines
• Boosting Monte Carlo simulations of spin glasses using autoregressive neural networks
• Unbiased Monte Carlo Cluster Updates with Autoregressive Neural Networks
• Introduction to Normalizing Flows for Lattice Field Theory
• Hierarchical autoregressive neural networks for statistical systems

Cited by in corpus (5)

• Accelerating equilibrium spin-glass simulations using quantum annealers via generative deep learning
• Training normalizing flows with computationally intensive target probability distributions
• Rényi entanglement entropy of spin chain with Generative Neural Networks
• Simulating first-order phase transition with hierarchical autoregressive networks
• NeuMC -- a package for neural sampling for lattice field theories