Thermodynamics and Feature Extraction by Machine Learning

Abstract

Machine learning methods are powerful in distinguishing different phases of matter in an automated way and provide a new perspective on the study of physical phenomena. We train a Restricted Boltzmann Machine (RBM) on data constructed with spin configurations sampled from the Ising Hamiltonian at different values of temperature and external magnetic field using Monte Carlo methods. From the trained machine we obtain the flow of iterative reconstruction of spin state configurations to faithfully reproduce the observables of the physical system. We find that the flow of the trained RBM approaches the spin configurations of the maximal possible specific heat which resemble the near criticality region of the Ising model. In the special case of the vanishing magnetic field the trained RBM converges to the critical point of the Renormalization Group (RG) flow of the lattice model. Our results suggest an alternative explanation of how the machine identifies the physical phase transitions, by recognizing certain properties of the configuration like the maximization of the specific heat, instead of associating directly the recognition procedure with the RG flow and its fixed points. Then from the reconstructed data we deduce the critical exponent associated to the magnetization to find satisfactory agreement with the actual physical value. We assume no prior knowledge about the criticality of the system and its Hamiltonian.

arXiv comment11 pages, double column format, 10 figures

References in corpus (28)

• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Machine learning phases of matter
• Searching for Exotic Particles in High-Energy Physics with Deep Learning
• A high-bias, low-variance introduction to Machine Learning for physicists
• Many-body quantum state tomography with neural networks
• Learning phase transitions by confusion
• Discovering Phase Transitions with Unsupervised Learning
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• Why does deep and cheap learning work so well?
• Machine learning quantum phases of matter beyond the fermion sign problem
• Discovering Phases, Phase Transitions and Crossovers through Unsupervised Machine Learning: A critical examination
• Quantum Loop Topography for Machine Learning
• Learning Thermodynamics with Boltzmann Machines
• Approximating quantum many-body wave-functions using artificial neural networks
• Mutual Information, Neural Networks and the Renormalization Group
• Detection of phase transition via convolutional neural network
• Machine Learning of Explicit Order Parameters: From the Ising Model to SU(2) Lattice Gauge Theory
• Probing many-body localization with neural networks
• Strongly-coupled anisotropic gauge theories and holography
• Machine Learning ${\mathbb{Z}}_2$ Quantum Spin Liquids with Quasi-particle Statistics
• Deep Learning and AdS/CFT
• Parameter diagnostics of phases and phase transition learning by neural networks
• Scale-invariant Feature Extraction of Neural Network and Renormalization Group Flow
• Deep Learning and Holographic QCD
• Learning phase transitions from dynamics
• Restricted Boltzmann Machines for the Long Range Ising Models
• Machine learning for many-body physics: efficient solution of dynamical mean-field theory
• RG inspired Machine Learning for lattice field theory

Cited by in corpus (23)

• Reducing Autocorrelation Times in Lattice Simulations with Generative Adversarial Networks
• Is Deep Learning a Renormalization Group Flow?
• Renormalization Group Flow as Optimal Transport
• Neural Network flows of low q-state Potts and clock Models
• Neural Monte Carlo Renormalization Group
• Unsupervised mapping of phase diagrams of 2D systems from infinite projected entangled-pair states via deep anomaly detection
• Machine learning for structure-property relationships: Scalability and limitations
• Machine learning phase transitions of the three-dimensional Ising universality class
• Short sighted deep learning
• Why Unsupervised Deep Networks Generalize
• Deep learning of phase transitions with minimal examples
• Thermodynamics of the Ising model encoded in restricted Boltzmann machines
• Probing phase transitions with correlations in configuration space
• Berezinskii-Kosterlitz-Thouless transition from Neural Network Flows
• Exploring percolation phase transition in the three-dimensional Ising model with machine learning
• Self-regularizing restricted Boltzmann machines
• Feature extraction of machine learning and phase transition point of Ising model
• Dynamic neuron approach to deep neural networks: Decoupling neurons for renormalization group analysis
• Discovering quasiorder parameters in the Potts model: A bridge between machine learning and critical phenomena
• Maximum Multiscale Entropy and Neural Network Regularization
• Deep learning of thermodynamic laws from microscopic dynamics
• Autonomous Discovery of the Ising Model's Critical Parameters with Reinforcement Learning
• Unsupervised classification of disordered patterns in an oppositely charged colloidal system