Phase transition encoded in neural network

Abstract

We discuss an aspect of neural networks for the purpose of phase transition detection. To this end, we first train the neural network by feeding Ising/Potts configurations with labels of temperature so that it can predict the temperature of input. We do not explicitly supervise whether the configurations are in ordered/disordered phase. Nevertheless, we can identify the critical temperature from the parameters (weights and biases) of trained neural network. We attempt to understand how temperature-supervised neural networks capture the information of phase transition by paying attention to what quantities they learn. Our detailed analyses reveal that they learn different physical quantities depending on how well they are trained. Main observation in this study is how the weights in the trained neural-network can have information of the phase transition in addition to temperature.

arXiv comment20 pages, 15 figures; version accepted in Progress of Theoretical and Experimental Physics

References in corpus (22)

• Machine learning phases of matter
• Learning phase transitions by confusion
• Discovering Phase Transitions with Unsupervised Learning
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• Machine learning quantum phases of matter beyond the fermion sign problem
• Discovering Phases, Phase Transitions and Crossovers through Unsupervised Machine Learning: A critical examination
• Quantum Loop Topography for Machine Learning
• Machine Learning Topological Invariants with Neural Networks
• Machine learning vortices at the Kosterlitz-Thouless transition
• Detection of phase transition via convolutional neural network
• Machine Learning of Explicit Order Parameters: From the Ising Model to SU(2) Lattice Gauge Theory
• Probing many-body localization with neural networks
• Kernel methods for interpretable machine learning of order parameters
• Deep Learning the Quantum Phase Transitions in Random Two-Dimensional Electron Systems
• Machine Learning ${\mathbb{Z}}_2$ Quantum Spin Liquids with Quasi-particle Statistics
• Parameter diagnostics of phases and phase transition learning by neural networks
• Deep Learning Topological Invariants of Band Insulators
• Scale-invariant Feature Extraction of Neural Network and Renormalization Group Flow
• Smallest Neural Network to Learn the Ising Criticality
• Deep Neural Network Detects Quantum Phase Transition
• Phase Diagrams of Three-Dimensional Anderson and Quantum Percolation Models using Deep Three-Dimensional Convolutional Neural Network
• A machine learning approach to the Berezinskii-Kosterlitz-Thouless transition in classical and quantum models

Cited by in corpus (17)

• Machine learning and the physical sciences
• The critical temperature of the 2D-Ising model through Deep Learning Autoencoders
• Drawing Phase Diagrams of Random Quantum Systems by Deep Learning the Wave Functions
• Towards Novel Insights in Lattice Field Theory with Explainable Machine Learning
• Generative models for sampling and phase transition indication in spin systems
• A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations
• Can a CNN trained on the Ising model detect the phase transition of the $q$-state Potts model?
• Machine learning phase transitions of the three-dimensional Ising universality class
• Learning to find order in disorder
• Emergence of a finite-size-scaling function in the supervised learning of the Ising phase transition
• Thermodynamics of the Ising model encoded in restricted Boltzmann machines
• Exploring percolation phase transition in the three-dimensional Ising model with machine learning
• Randomized-gauge test for machine learning of Ising model order parameter
• Phase transition for parameter learning of Hidden Markov Models
• Discovering quasiorder parameters in the Potts model: A bridge between machine learning and critical phenomena
• Machine learning in physics: The pitfalls of poisoned training sets
• Deep learning of thermodynamic laws from microscopic dynamics