Rayleigh-Gauss-Newton optimization with enhanced sampling for variational Monte Carlo

Abstract

Variational Monte Carlo (VMC) is an approach for computing ground-state wavefunctions that has recently become more powerful due to the introduction of neural network-based wavefunction parametrizations. However, efficiently training neural wavefunctions to converge to an energy minimum remains a difficult problem. In this work, we analyze optimization and sampling methods used in VMC and introduce alterations to improve their performance. First, based on theoretical convergence analysis in a noiseless setting, we motivate a new optimizer that we call the Rayleigh-Gauss-Newton method, which can improve upon gradient descent and natural gradient descent to achieve superlinear convergence at no more than twice the computational cost. Second, in order to realize this favorable comparison in the presence of stochastic noise, we analyze the effect of sampling error on VMC parameter updates and experimentally demonstrate that it can be reduced by the parallel tempering method. In particular, we demonstrate that RGN can be made robust to energy spikes that occur when the sampler moves between metastable regions of configuration space. Finally, putting theory into practice, we apply our enhanced optimization and sampling methods to the transverse-field Ising and XXZ models on large lattices, yielding ground-state energy estimates with remarkably high accuracy after just 200 parameter updates.

arXiv comment12 pages, 8 figures

References in corpus (19)

• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• On the Convergence of Adam and Beyond
• Deep neural network solution of the electronic Schrödinger equation
• Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks
• Quantum Natural Gradient
• Optimizing Neural Networks with Kronecker-factored Approximate Curvature
• Generalized Lanczos Algorithm for Variational Quantum Monte Carlo
• Recurrent Neural Network Wave Functions
• Deep autoregressive models for the efficient variational simulation of many-body quantum systems
• Symmetries and many-body excited states with neural-network quantum states
• Weak binding between two aromatic rings: feeling the van der Waals attraction by quantum Monte Carlo methods
• Backflow Transformations via Neural Networks for Quantum Many-Body Wave-Functions
• Avoiding local minima in variational quantum eigensolvers with the natural gradient optimizer
• Neural Quantum States of frustrated magnets: generalization and sign structure
• Optimizing large parameter sets in variational quantum Monte Carlo
• Geometry of learning neural quantum states
• Deep Learning-Enhanced Variational Monte Carlo Method for Quantum Many-Body Physics
• An accelerated linear method for optimizing non-linear wavefunctions in variational Monte Carlo
• Scalable variational Monte Carlo with graph neural ansatz

Cited by in corpus (2)

• A Kaczmarz-inspired approach to accelerate the optimization of neural network wavefunctions
• Understanding and eliminating spurious modes in variational Monte Carlo using collective variables