Accelerate Monte Carlo Simulations with Restricted Boltzmann Machines

Abstract

Despite their exceptional flexibility and popularity, the Monte Carlo methods often suffer from slow mixing times for challenging statistical physics problems. We present a general strategy to overcome this difficulty by adopting ideas and techniques from the machine learning community. We fit the unnormalized probability of the physical model to a feedforward neural network and reinterpret the architecture as a restricted Boltzmann machine. Then, exploiting its feature detection ability, we utilize the restricted Boltzmann machine for efficient Monte Carlo updates and to speed up the simulation of the original physical system. We implement these ideas for the Falicov-Kimball model and demonstrate improved acceptance ratio and autocorrelation time near the phase transition point.

References in corpus (22)

• Determining the density of states for classical statistical models: A random walk algorithm to produce a flat histogram
• Quantum Monte Carlo methods for nuclear physics
• The ALPS project release 2.0: Open source software for strongly correlated systems
• Finding Density Functionals with Machine Learning
• Discovering Phase Transitions with Unsupervised Learning
• Exact, Complete, and Universal Continuous-Time Worldline Monte Carlo Approach to the Statistics of Discrete Quantum Systems
• Cluster Algorithm for Vertex Models
• Nature of the superconductor-insulator transition in disordered superconductors
• Learning Thermodynamics with Boltzmann Machines
• Self-Learning Monte Carlo Method
• Vaporization of Kitaev spin liquids
• Sign-problem-free quantum Monte Carlo of the onset of antiferromagnetism in metals
• Light Hadron Masses from Lattice QCD
• Machine learning for many-body physics: The case of the Anderson impurity model
• Hybrid Monte Carlo algorithm for the Double Exchange Model
• The fermion bag approach to lattice field theories
• Thermodynamics of the two-dimensional Falicov-Kimball model: a classical Monte Carlo study
• A Monte Carlo Method for Fermion Systems Coupled with Classical Degrees of Freedom
• Phase Fluctuations in Strongly Coupled $d$-Wave Superconductors
• Interaction-tuned Anderson versus Mott localization
• Critical Exponents of Strongly Correlated Fermion Systems from Diagrammatic Multi-Scale Methods
• The Truncated Polynomial Expansion Monte Carlo Method for Fermion Systems Coupled to Classical Fields: A Model Independent Implementation

Cited by in corpus (158)

• Machine learning and the physical sciences
• Noisy intermediate-scale quantum (NISQ) algorithms
• All Optical Neural Network with Nonlinear Activation Functions
• Quantum Entanglement in Neural Network States
• Machine learning quantum phases of matter beyond the fermion sign problem
• Restricted-Boltzmann-Machine Learning for Solving Strongly Correlated Quantum Systems
• Quantum Loop Topography for Machine Learning
• Machine Learning Topological Invariants with Neural Networks
• Self-Learning Monte Carlo Method
• Symmetries and many-body excited states with neural-network quantum states
• Equivalence of restricted Boltzmann machines and tensor network states
• Flow-based generative models for Markov chain Monte Carlo in lattice field theory
• Approximating quantum many-body wave-functions using artificial neural networks
• Neural-Network Quantum States, String-Bond States, and Chiral Topological States
• Equivariant flow-based sampling for lattice gauge theory
• A Neural Decoder for Topological Codes
• Constructing neural stationary states for open quantum many-body systems
• Neural Network Renormalization Group
• Machine Learning of Explicit Order Parameters: From the Ising Model to SU(2) Lattice Gauge Theory
• Machine Learning for Quantum Matter
• Kernel methods for interpretable machine learning of order parameters
• Unsupervised Learning of Frustrated Classical Spin Models I: Principle Component Analysis
• Solving the Bose-Hubbard model with machine learning
• Asymptotically unbiased estimation of physical observables with neural samplers
• Machine learning of phase transitions in the percolation and XY models
• Machine learning technique to find quantum many-body ground states of bosons on a lattice
• Discriminative Cooperative Networks for Detecting Phase Transitions
• Regressive and generative neural networks for scalar field theory
• Restricted Boltzmann Machines for Quantum States with Nonabelian or Anyonic Symmetries
• Quantum Neural Network States: A Brief Review of Methods and Applications
• Information Perspective to Probabilistic Modeling: Boltzmann Machines versus Born Machines
• Machine Learning for Condensed Matter Physics
• Machine Learning Spatial Geometry from Entanglement Features
• Deep Learning Topological Invariants of Band Insulators
• Identifying polymer states by machine learning
• Deep Learning the Ising Model Near Criticality
• Self-learning Monte Carlo with Deep Neural Networks
• Charge-Density-Wave Transitions of Dirac Fermions Coupled to Phonons
• Analytic continuation via domain-knowledge free machine learning
• Unifying Neural-network Quantum States and Correlator Product States via Tensor Networks
• Spectral Reconstruction with Deep Neural Networks
• Machine Learning Bell Nonlocality in Quantum Many-body Systems
• Learning Disordered Topological Phases by Statistical Recovery of Symmetry
• Deep Learning the Quantum Phase Transitions in Random Electron Systems: Applications to Three Dimensions
• Machine learning action parameters in lattice quantum chromodynamics
• Detecting quantum entanglement with unsupervised learning
• Machine Learning meets Quantum Foundations: A Brief Survey
• Self-Learning Monte Carlo Method: Continuous-Time Algorithm
• Boosting Monte Carlo simulations of spin glasses using autoregressive neural networks
• Smallest Neural Network to Learn the Ising Criticality
• Applications of neural networks to the studies of phase transitions of two-dimensional Potts models
• Efficient Modelling of Trivializing Maps for Lattice ${\varphi }^4$ Theory Using Normalizing Flows: A First Look at Scalability
• Symmetry Enforced Self-Learning Monte Carlo Method Applied to the Holstein Model
• Quantum phase recognition via unsupervised machine learning
• Principal Component Analysis for Fermionic Critical Points
• Matrix Product Operators for Sequence to Sequence Learning
• Machine Learning Holographic Mapping by Neural Network Renormalization Group
• Gauge-equivariant flow models for sampling in lattice field theories with pseudofermions
• Drawing Phase Diagrams of Random Quantum Systems by Deep Learning the Wave Functions
• Towards Novel Insights in Lattice Field Theory with Explainable Machine Learning
• Divergence of predictive model output as indication of phase transitions
• Deep Learning on the 2-Dimensional Ising Model to Extract the Crossover Region with a Variational Autoencoder
• Can Boltzmann Machines Discover Cluster Updates ?
• Hybrid convolutional neural network and PEPS wave functions for quantum many-particle states
• Scalability of all-optical neural networks based on spatial light modulators
• Interpretable machine learning for inferring the phase boundaries in a nonequilibrium system
• A machine-learning solver for modified diffusion equations
• Unbiased Monte Carlo Cluster Updates with Autoregressive Neural Networks
• Learning Quantum Hamiltonians from Single-qubit Measurements
• Accelerating lattice quantum Monte Carlo simulation using artificial neural networks: an application to the Holstein model
• Reducing Autocorrelation Times in Lattice Simulations with Generative Adversarial Networks
• Deep Learning and Quantum Entanglement: Fundamental Connections with Implications to Network Design
• Extending machine learning classification capabilities with histogram reweighting
• Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics
• Recommender Engine for Continuous Time Quantum Monte Carlo Methods
• Generative models for sampling and phase transition indication in spin systems
• Self-learning projective quantum Monte Carlo simulations guided by restricted Boltzmann machines
• Self-learning Monte Carlo method with Behler-Parrinello neural networks
• Phase Diagrams of Three-Dimensional Anderson and Quantum Percolation Models using Deep Three-Dimensional Convolutional Neural Network
• Exact representations of many body interactions with RBM neural networks
• Neural Canonical Transformation with Symplectic Flows
• Interpretable and unsupervised phase classification
• Protocol Discovery for the Quantum Control of Majoranas by Differentiable Programming and Natural Evolution Strategies
• Approximating power of machine-learning ansatz for quantum many-body states
• Artificial Neural Network Based Computation for Out-of-Time-Ordered Correlators
• Self-organizing maps as a method for detecting phase transitions and phase identification
• Machine learning electron correlation in a disordered medium
• Generalizing Hamiltonian Monte Carlo with Neural Networks
• Identifying Product Order with Restricted Boltzmann Machines
• Machine learning nonequilibrium electron forces for adiabatic spin dynamics
• Temperature evolution of the phonon dynamics in the Kitaev spin liquid
• Simulating disordered quantum systems via dense and sparse restricted Boltzmann machines
• Towards reduction of autocorrelation in HMC by machine learning
• Policy Guided Monte Carlo: Reinforcement Learning Markov Chain Dynamics
• Learning quantum phase transitions through Topological Data Analysis
• Barriers and Dynamical Paths in Alternating Gibbs Sampling of Restricted Boltzmann Machines
• Restricted Boltzmann Machines and Matrix Product States of 1D Translational Invariant Stabilizer Codes
• Identifying structural changes with unsupervised machine learning methods
• Machine learning effective models for quantum systems
• Transforming Generalized Ising Model into Boltzmann Machine
• Analysis of autocorrelation times in Neural Markov Chain Monte Carlo simulations
• Towards meaningful physics from generative models
• Boltzmann machines as two-dimensional tensor networks
• A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations
• Generation of ice states through deep reinforcement learning
• Data-Driven Dynamical Mean-Field Theory: an error-correction approach to solve the quantum many-body problem using machine learning
• A learning by confusion approach to characterize phase transitions
• Unsupervised machine learning approaches to the $q$-state Potts model
• Convolutional restricted Boltzmann machine aided Monte Carlo: An application to Ising and Kitaev models
• Machine learning generated configurations in presence of a conserved quantity: a cautionary tale
• Machine learning phases and criticalities without using real data for training
• Visualizing Neural Network Developing Perturbation Theory
• Engineering Topological Phases Guided by Statistical and Machine Learning Methods
• Transformer neural networks and quantum simulators: a hybrid approach for simulating strongly correlated systems
• Deep recurrent networks predicting the gap evolution in adiabatic quantum computing
• Tensor network language model
• The percolating cluster is invisible to image recognition with deep learning
• Neural networks in quantum many-body physics: a hands-on tutorial
• On the descriptive power of Neural-Networks as constrained Tensor Networks with exponentially large bond dimension
• The one-dimensional Long-Range Falikov-Kimball Model: Thermal Phase Transition and Disorder-Free Localisation
• RG inspired Machine Learning for lattice field theory
• Machine-learning approach to finite-size effects in systems with strongly interacting fermions
• Nonequilibrium charge transport through Falicov-Kimball structures connected to metallic leads
• Accelerating equilibrium spin-glass simulations using quantum annealers via generative deep learning
• Universal crossover from ground state to excited-state quantum criticality
• Generative learning for the problem of critical slowing down in lattice Gross Neveu model
• Gapless regime in the charge density wave phase of the finite dimensional Falicov-Kimball model
• Probing Criticality in Quantum Spin Chains with Neural Networks
• Quantum self-learning Monte Carlo with quantum Fourier transform sampler
• Neural network enhanced hybrid quantum many-body dynamical distributions
• Variational Autoencoder Analysis of Ising Model Statistical Distributions and Phase Transitions
• Self-Supervised Learning of Generative Spin-Glasses with Normalizing Flows
• Adaptive Monte Carlo augmented with normalizing flows
• Efficient and quantum-adaptive machine learning with fermion neural networks
• Electronic transport through correlated electron systems with nonhomogeneous charge orderings
• Network-Initialized Monte Carlo Based on Generative Neural Networks
• Thermodynamics of the Ising model encoded in restricted Boltzmann machines
• Automatic Learning of Topological Phase Boundaries
• Application of the Variational Autoencoder to Detect the Critical Points of the Anisotropic Ising Model
• A Probability Density Theory for Spin-Glass Systems
• Phase classification in the long-range Harper model using machine learning
• Fluctuation based interpretable analysis scheme for quantum many-body snapshots
• Unsupervised Machine Learning Phase Classification for Falicov-Kimball Model
• Machine learning, quantum chaos, and pseudorandom evolution
• Sample generation for the spin-fermion model using neural networks
• Effective classical correspondence of the Mott transition
• Self-dual criticality in three-dimensional ${\mathbb{Z}}_2$ gauge theory with matter
• Dipole-dipole interaction induced phases in Hydrogen-bonded squaric acid crystal
• Discovering quasiorder parameters in the Potts model: A bridge between machine learning and critical phenomena
• Resolution and Relevance Trade-offs in Deep Learning
• Efficiency of neural-network state representations of one-dimensional quantum spin systems
• Machine learning dynamics of phase separation in correlated electron magnets
• Quantum Markov chain Monte Carlo method with programmable quantum simulators
• Efficient bit encoding of neural networks for Fock states
• Weakly-supervised learning on Schrodinger equation
• Global sampling of Feynman's diagrams through Normalizing Flow
• Unsupervised classification of disordered patterns in an oppositely charged colloidal system
• Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning