Understanding and eliminating spurious modes in variational Monte Carlo using collective variables

Abstract

The use of neural network parametrizations to represent the ground state in variational Monte Carlo (VMC) calculations has generated intense interest in recent years. However, as we demonstrate in the context of the periodic Heisenberg spin chain, this approach can produce unreliable wave function approximations. One of the most obvious signs of failure is the occurrence of random, persistent spikes in the energy estimate during training. These energy spikes are caused by regions of configuration space that are over-represented by the wave function density, which are called ``spurious modes'' in the machine learning literature. After exploring these spurious modes in detail, we demonstrate that a collective-variable-based penalization yields a substantially more robust training procedure, preventing the formation of spurious modes and improving the accuracy of energy estimates. Because the penalization scheme is cheap to implement and is not specific to the particular model studied here, it can be extended to other applications of VMC where a reasonable choice of collective variable is available.

arXiv comment12 pages, 13 figures

References in corpus (14)

• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Parallel Tempering: Theory, Applications, and New Perspectives
• Deep neural network solution of the electronic Schrödinger equation
• Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks
• Continuum variational and diffusion quantum Monte Carlo calculations
• Quantum Boltzmann Machine
• Backflow Transformations via Neural Networks for Quantum Many-Body Wave-Functions
• Neural Quantum States of frustrated magnets: generalization and sign structure
• mVMC - Open-source software for many-variable variational Monte Carlo method
• Geometry of learning neural quantum states
• Deep Learning-Enhanced Variational Monte Carlo Method for Quantum Many-Body Physics
• Umbrella sampling: a powerful method to sample tails of distributions
• Eigenvector method for umbrella sampling enables error analysis
• Rayleigh-Gauss-Newton optimization with enhanced sampling for variational Monte Carlo