Optimizing Temperature Distributions for Training Neural Quantum States using Parallel Tempering

Abstract

Parameterized artificial neural networks (ANNs) can be very expressive ansatzes for variational algorithms, reaching state-of-the-art energies on many quantum many-body Hamiltonians. Nevertheless, the training of the ANN can be slow and stymied by the presence of local minima in the parameter landscape. One approach to mitigate this issue is to use parallel tempering methods, and in this work we focus on the role played by the temperature distribution of the parallel tempering replicas. Using an adaptive method that adjusts the temperatures in order to equate the exchange probability between neighboring replicas, we show that this temperature optimization can significantly increase the success rate of the variational algorithm with negligible computational cost by eliminating bottlenecks in the replicas' random walk. We demonstrate this using two different neural networks, a restricted Boltzmann machine and a feedforward network, which we use to study a toy problem based on a permutation invariant Hamiltonian with a pernicious local minimum and the J1-J2 model on a rectangular lattice.

13 pages, 9 figures. v2: Updated to published article

References in corpus (22)

• The density-matrix renormalization group in the age of matrix product states
• The density-matrix renormalization group
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Feedback-optimized parallel tempering Monte Carlo
• Quantum many-body dynamics in two dimensions with artificial neural networks
• NetKet 3: Machine Learning Toolbox for Many-Body Quantum Systems
• Neural Quantum States of frustrated magnets: generalization and sign structure
• Dirac-type nodal spin liquid revealed by refined quantum many-body solver using neural-network wave function, correlation ratio, and level spectroscopy
• NetKet: A Machine Learning Toolkit for Many-Body Quantum Systems
• Quantum Neural Network States: A Brief Review of Methods and Applications
• Neural network wave functions and the sign problem
• Empowering deep neural quantum states through efficient optimization
• Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape
• High-accuracy variational Monte Carlo for frustrated magnets with deep neural networks
• Towards the ground state of molecules via diffusion Monte Carlo on neural networks
• ALGORITHM 937: MINRES-QLP for Singular Symmetric and Hermitian Linear Equations and Least-Squares Problems
• Neural-network quantum states for many-body physics
• Effects of setting the temperatures in the parallel tempering Monte Carlo algorithm
• $2^{1296}$ Exponentially Complex Quantum Many-Body Simulation via Scalable Deep Learning Method
• Fine-tuning Neural Network Quantum States
• Solving Fermi-Hubbard-type Models by Tensor Representations of Backflow Corrections
• Quantum-Inspired Tempering for Ground State Approximation using Artificial Neural Networks