Transfer learning for scalability of neural-network quantum states

Abstract

Neural-network quantum states have shown great potential for the study of many-body quantum systems. In statistical machine learning, transfer learning designates protocols reusing features of a machine learning model trained for a problem to solve a possibly related but different problem. We propose to evaluate the potential of transfer learning to improve the scalability of neural-network quantum states. We devise and present physics-inspired transfer learning protocols, reusing the features of neural-network quantum states learned for the computation of the ground state of a small system for systems of larger sizes. We implement different protocols for restricted Boltzmann machines on general-purpose graphics processing units. This implementation alone yields a speedup over existing implementations on multi-core and distributed central processing units in comparable settings. We empirically and comparatively evaluate the efficiency (time) and effectiveness (accuracy) of different transfer learning protocols as we scale the system size in different models and different quantum phases. Namely, we consider both the transverse field Ising and Heisenberg XXZ models in one dimension, and also in two dimensions for the latter, with system sizes up to 128 and 8 x 8 spins. We empirically demonstrate that some of the transfer learning protocols that we have devised can be far more effective and efficient than starting from neural-network quantum states with randomly initialized parameters.

13 pages, 11 figures

References in corpus (17)

• The density-matrix renormalization group in the age of matrix product states
• The density-matrix renormalization group
• Machine learning and the physical sciences
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• A Practical Introduction to Tensor Networks: Matrix Product States and Projected Entangled Pair States
• Matrix Product States, Projected Entangled Pair States, and variational renormalization group methods for quantum spin systems
• Finite-Size Scaling of the Ground State Parameters of the Two-Dimensional Heisenberg Model
• Quantum Entanglement in Neural Network States
• Deep autoregressive models for the efficient variational simulation of many-body quantum systems
• Symmetries and many-body excited states with neural-network quantum states
• Study of the Two-Dimensional Frustrated J1-J2 Model with Neural Network Quantum States
• Weak binding between two aromatic rings: feeling the van der Waals attraction by quantum Monte Carlo methods
• Machine learning meets quantum physics
• Neural Quantum States of frustrated magnets: generalization and sign structure
• NetKet: A Machine Learning Toolkit for Many-Body Quantum Systems
• Quantum Neural Network States: A Brief Review of Methods and Applications
• Quenches near Ising quantum criticality as a challenge for artificial neural networks

Cited by in corpus (28)

• Transfer learning in hybrid classical-quantum neural networks
• Neural Quantum States of frustrated magnets: generalization and sign structure
• Mapping distinct phase transitions to a neural network
• Mitigating Barren Plateaus with Transfer-learning-inspired Parameter Initializations
• Classifying global state preparation via deep reinforcement learning
• A Neural-Network Variational Quantum Algorithm for Many-Body Dynamics
• Scalable neural networks for the efficient learning of disordered quantum systems
• Lee-Yang theory of criticality in interacting quantum many-body systems
• Energy landscape analysis based on the Ising model: Tutorial review
• Gaussian Process States: A data-driven representation of quantum many-body physics
• Ground state search by local and sequential updates of neural network quantum states
• Optical lattice experiments at unobserved conditions and scales through generative adversarial deep learning
• The quantum Gaussian process state: A kernel-inspired state with quantum support data
• A Bayesian Inference Framework for Compression and Prediction of Quantum States
• Exponentially improved efficient machine learning for quantum many-body states with provable guarantees
• SEQUENT: Towards Traceable Quantum Machine Learning using Sequential Quantum Enhanced Training
• Approximately-symmetric neural networks for quantum spin liquids
• Transfer learning from Hermitian to non-Hermitian quantum many-body physics
• Supervised Training of Neural-Network Quantum States for the Next Nearest Neighbor Ising model
• Finding Quantum Critical Points with Neural-Network Quantum States
• Zero-temperature Monte Carlo simulations of two-dimensional quantum spin glasses guided by neural network states
• Reinforcement learning to learn quantum states for Heisenberg scaling accuracy
• Gaussian Processes for Finite Size Extrapolation of Many-Body Simulations
• Many-Body Neural Network Wavefunction for a Non-Hermitian Ising Chain
• Neural-Network Quantum States for Periodic Systems in Continuous Space
• Challenges and opportunities in the supervised learning of quantum circuit outputs
• Transfer learning of many-body electronic correlation entropy from local measurements
• Optimized Observable Readout from Single-shot Images of Ultracold Atoms via Machine Learning