Learning Thermodynamics with Boltzmann Machines

Abstract

A Boltzmann machine is a stochastic neural network that has been extensively used in the layers of deep architectures for modern machine learning applications. In this paper, we develop a Boltzmann machine that is capable of modelling thermodynamic observables for physical systems in thermal equilibrium. Through unsupervised learning, we train the Boltzmann machine on data sets constructed with spin configurations importance-sampled from the partition function of an Ising Hamiltonian at different temperatures using Monte Carlo (MC) methods. The trained Boltzmann machine is then used to generate spin states, for which we compare thermodynamic observables to those computed by direct MC sampling. We demonstrate that the Boltzmann machine can faithfully reproduce the observables of the physical system. Further, we observe that the number of neurons required to obtain accurate results increases as the system is brought close to criticality.

8 pages, 5 figures

Cited by in corpus (159)

• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Many-body quantum state tomography with neural networks
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• Discovering physical concepts with neural networks
• Quantum Entanglement in Neural Network States
• Machine learning quantum phases of matter beyond the fermion sign problem
• Discovering Phases, Phase Transitions and Crossovers through Unsupervised Machine Learning: A critical examination
• Restricted-Boltzmann-Machine Learning for Solving Strongly Correlated Quantum Systems
• Machine Learning Topological States
• Quantum Loop Topography for Machine Learning
• Machine Learning Phases of Strongly Correlated Fermions
• Self-Learning Monte Carlo Method
• Accelerate Monte Carlo Simulations with Restricted Boltzmann Machines
• Equivalence of restricted Boltzmann machines and tensor network states
• Provably efficient machine learning for quantum many-body problems
• Neural-Network Quantum States, String-Bond States, and Chiral Topological States
• Mutual Information, Neural Networks and the Renormalization Group
• Solving parametric PDE problems with artificial neural networks
• A Neural Decoder for Topological Codes
• Constructing neural stationary states for open quantum many-body systems
• Unsupervised machine learning account of magnetic transitions in the Hubbard model
• Machine Learning of Explicit Order Parameters: From the Ising Model to SU(2) Lattice Gauge Theory
• Machine Learning for Quantum Matter
• Probing many-body localization with neural networks
• Integrating Neural Networks with a Quantum Simulator for State Reconstruction
• Latent Space Purification via Neural Density Operators
• Kernel methods for interpretable machine learning of order parameters
• Unsupervised Learning of Frustrated Classical Spin Models I: Principle Component Analysis
• Solving the Bose-Hubbard model with machine learning
• Asymptotically unbiased estimation of physical observables with neural samplers
• Machine learning of phase transitions in the percolation and XY models
• Machine learning technique to find quantum many-body ground states of bosons on a lattice
• Regressive and generative neural networks for scalar field theory
• Machine learning quantum states in the NISQ era
• Restricted Boltzmann Machines for Quantum States with Nonabelian or Anyonic Symmetries
• Quantum Neural Network States: A Brief Review of Methods and Applications
• Information Perspective to Probabilistic Modeling: Boltzmann Machines versus Born Machines
• Unveiling phase transitions with machine learning
• Deep Learning and AdS/CFT
• Cellular automata as convolutional neural networks
• Exploring QCD matter in extreme conditions with Machine Learning
• Machine Learning Spatial Geometry from Entanglement Features
• Identifying polymer states by machine learning
• Scale-invariant Feature Extraction of Neural Network and Renormalization Group Flow
• Analytic continuation via domain-knowledge free machine learning
• Automatic spin-chain learning to explore the quantum speed limit
• Unifying Neural-network Quantum States and Correlator Product States via Tensor Networks
• Precise measurement of quantum observables with neural-network estimators
• Learning Disordered Topological Phases by Statistical Recovery of Symmetry
• Machine Learning Bell Nonlocality in Quantum Many-body Systems
• Machine learning action parameters in lattice quantum chromodynamics
• Super-resolving the Ising model with convolutional neural networks
• Discovering Symmetry Invariants and Conserved Quantities by Interpreting Siamese Neural Networks
• Identifying the nature of the QCD transition in relativistic collision of heavy nuclei with deep learning
• Perspectives on adaptive dynamical systems
• Machine Learning meets Quantum Foundations: A Brief Survey
• Boosting Monte Carlo simulations of spin glasses using autoregressive neural networks
• Smallest Neural Network to Learn the Ising Criticality
• Unsupervised machine learning of quantum phase transitions using diffusion maps
• Symbolic Pregression: Discovering Physical Laws from Distorted Video
• Efficient Modelling of Trivializing Maps for Lattice ${\varphi }^4$ Theory Using Normalizing Flows: A First Look at Scalability
• Applications of neural networks to the studies of phase transitions of two-dimensional Potts models
• The learnability scaling of quantum states: restricted Boltzmann machines
• Machine Learning Holographic Mapping by Neural Network Renormalization Group
• Matrix Product Operators for Sequence to Sequence Learning
• Holography as deep learning
• Machine Learning of Frustrated Classical Spin Models. II. Kernel Principal Component Analysis
• Thermodynamics and Feature Extraction by Machine Learning
• Riemannian geometry and automatic differentiation for optimization problems of quantum physics and quantum technologies
• Deep learning stochastic processes with QCD phase transition
• Status and Future Perspectives for Lattice Gauge Theory Calculations to the Exascale and Beyond
• Learning the Ising Model with Generative Neural Networks
• Mapping distinct phase transitions to a neural network
• Machine learning determination of dynamical parameters: The Ising model case
• Deep Learning on the 2-Dimensional Ising Model to Extract the Crossover Region with a Variational Autoencoder
• Imaginary components of out-of-time correlators and information scrambling for navigating the learning landscape of a quantum machine learning model
• Can Boltzmann Machines Discover Cluster Updates ?
• Neural-network-designed pulse sequences for robust control of singlet-triplet qubits
• A machine-learning solver for modified diffusion equations
• Accelerating lattice quantum Monte Carlo simulation using artificial neural networks: an application to the Holstein model
• Quantum Phase Recognition via Quantum Kernel Methods
• Improved machine learning algorithm for predicting ground state properties
• Phase diagram study of a two-dimensional frustrated antiferromagnet via unsupervised machine learning
• U(1) symmetric recurrent neural networks for quantum state reconstruction
• Reducing Autocorrelation Times in Lattice Simulations with Generative Adversarial Networks
• Deep Learning and Quantum Entanglement: Fundamental Connections with Implications to Network Design
• Extending machine learning classification capabilities with histogram reweighting
• Estimating the degree of non-Markovianity using machine learning
• Generative training of quantum Boltzmann machines with hidden units
• Machine Learning Application to Two-Dimensional Dzyaloshinskii-Moriya Ferromagnets
• QuCumber: wavefunction reconstruction with neural networks
• Extracting Critical Exponent by Finite-Size Scaling with Convolutional Neural Networks
• A perspective on machine learning and data science for strongly correlated electron problems
• Generative models for sampling and phase transition indication in spin systems
• Few-shot machine learning in the three-dimensional Ising model
• Nonequilibrium Thermodynamics of Restricted Boltzmann Machines
• Artificial Neural Network Based Computation for Out-of-Time-Ordered Correlators
• Data-Enhanced Variational Monte Carlo Simulations for Rydberg Atom Arrays
• Self-organizing maps as a method for detecting phase transitions and phase identification
• Approximating power of machine-learning ansatz for quantum many-body states
• Optimal Renormalization Group Transformation from Information Theory
• Machine learning of phase transitions in nonlinear polariton lattices
• Machine learning electron correlation in a disordered medium
• Identifying Product Order with Restricted Boltzmann Machines
• A Neural Networks study of the phase transitions of Potts model
• Emergent Quantum Mechanics in an Introspective Machine Learning Architecture
• Reconstructing quantum molecular rotor ground states
• On dissipative symplectic integration with applications to gradient-based optimization
• Learning a Local Symmetry with Neural-Networks
• Neural network approach to quasiparticle dispersions in doped antiferromagnets
• Transforming Generalized Ising Model into Boltzmann Machine
• Ground state phase diagram of the one-dimensional Bose-Hubbard model from restricted Boltzmann machines
• Generation of ice states through deep reinforcement learning
• Towards meaningful physics from generative models
• Extracting many-particle entanglement entropy from observables using supervised machine learning
• Neural network enhanced measurement efficiency for molecular groundstates
• Convolutional restricted Boltzmann machine aided Monte Carlo: An application to Ising and Kitaev models
• Machine learning generated configurations in presence of a conserved quantity: a cautionary tale
• Machine learning phases and criticalities without using real data for training
• On the descriptive power of Neural-Networks as constrained Tensor Networks with exponentially large bond dimension
• Pruning a restricted Boltzmann machine for quantum state reconstruction
• Tensor network language model
• Neural networks in quantum many-body physics: a hands-on tutorial
• Machine learning for structure-property relationships: Scalability and limitations
• Sampling scheme for neuromorphic simulation of entangled quantum systems
• Magnetic Phases of Spatially-Modulated Spin-1 Chains in Rydberg Excitons: Classical and Quantum Simulations
• Feeding the multitude: A polynomial-time algorithm to improve sampling
• Machine learning phase transitions of the three-dimensional Ising universality class
• Generative learning for the problem of critical slowing down in lattice Gross Neveu model
• Probing Criticality in Quantum Spin Chains with Neural Networks
• Sampling U(1) gauge theory using a re-trainable conditional flow-based model
• Variational Autoencoder Analysis of Ising Model Statistical Distributions and Phase Transitions
• Generative Neural Samplers for the Quantum Heisenberg Chain
• Unsupervised Learning of Rydberg Atom Array Phase Diagram with Siamese Neural Networks
• Predicting quantum many-body dynamics with transferable neural networks
• Conservation Laws and Spin System Modeling through Principal Component Analysis
• Thermodynamics of the Ising model encoded in restricted Boltzmann machines
• Neural-network Quantum State of Transverse-field Ising Model
• Learning What a Machine Learns in a Many-Body Localization Transition
• Machine learning classification of two-dimensional vortex configurations
• Application of the Variational Autoencoder to Detect the Critical Points of the Anisotropic Ising Model
• Noise signal as input data in self-organized neural networks
• Sample generation for the spin-fermion model using neural networks
• A Tensor Network Approach to Finite Markov Decision Processes
• An Enquiry on similarities between Renormalization Group and Auto-Encoders using Transfer Learning
• Quantum Machine Learning For Classical Data
• Efficiency of neural-network state representations of one-dimensional quantum spin systems
• A universal neural network for learning phases and criticalities
• Towards neural reinforcement learning for large deviations in nonequilibrium systems with memory
• Self-regularizing restricted Boltzmann machines
• Employing machine learning for theory validation and identification of experimental conditions in laser-plasma physics
• Learning the dynamics of Markovian open quantum systems from experimental data
• Relevant Analytic Spontaneous Magnetization Relation for the Face-Centered-Cubic Ising Lattice
• Unsupervised classification of disordered patterns in an oppositely charged colloidal system
• Deep learning of thermodynamic laws from microscopic dynamics
• Optimized Observable Readout from Single-shot Images of Ultracold Atoms via Machine Learning
• Exact training of Restricted Boltzmann machines on intrinsically low dimensional data
• Learning disentangled representation for classical models
• Finding Quantum Many-Body Ground States with Artificial Neural Network