Machine learning of phase transitions in the percolation and XY models

Abstract

In this paper, we apply machine learning methods to study phase transitions in certain statistical mechanical models on the two dimensional lattices, whose transitions involve non-local or topological properties, including site and bond percolations, the XY model and the generalized XY model. We find that using just one hidden layer in a fully-connected neural network, the percolation transition can be learned and the data collapse by using the average output layer gives correct estimate of the critical exponent $\nu$. We also study the Berezinskii-Kosterlitz-Thouless transition, which involves binding and unbinding of topological defects---vortices and anti-vortices, in the classical XY model. The generalized XY model contains richer phases, such as the nematic phase, the paramagnetic and the quasi-long-range ferromagnetic phases, and we also apply machine learning method to it. We obtain a consistent phase diagram from the network trained with only data along the temperature axis at two particular parameter $\Delta$ values, where $\Delta$ is the relative weight of pure XY coupling. Besides using the spin configurations (either angles or spin components) as the input information in a convolutional neural network, we devise a feature engineering approach using the histograms of the spin orientations in order to train the network to learn the three phases in the generalized XY model and demonstrate that it indeed works. The trained network by using system size $L\times L$ can be used to the phase diagram for other sizes ($L^{\prime }\times L^{\prime }$, where $L^{\prime }\ne L$) without any further training.

arXiv comment13 pages, 16 figures

References in corpus (47)

• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Machine learning phases of matter
• Many-body quantum state tomography with neural networks
• Learning phase transitions by confusion
• Discovering Phase Transitions with Unsupervised Learning
• A fast Monte Carlo algorithm for site or bond percolation
• Efficient Monte Carlo algorithm and high-precision results for percolation
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• Recent advances in percolation theory and its applications
• Quantum Entanglement in Neural Network States
• Machine learning quantum phases of matter beyond the fermion sign problem
• Discovering Phases, Phase Transitions and Crossovers through Unsupervised Machine Learning: A critical examination
• Efficient Representation of Quantum Many-body States with Deep Neural Networks
• Reinforcement Learning in Different Phases of Quantum Control
• Machine Learning Topological States
• Quantum Loop Topography for Machine Learning
• Machine Learning Topological Invariants with Neural Networks
• Learning Thermodynamics with Boltzmann Machines
• Machine Learning Phases of Strongly Correlated Fermions
• Self-Learning Monte Carlo Method
• Accelerate Monte Carlo Simulations with Restricted Boltzmann Machines
• Equivalence of restricted Boltzmann machines and tensor network states
• A Neural Decoder for Topological Codes
• Machine learning vortices at the Kosterlitz-Thouless transition
• Unsupervised machine learning account of magnetic transitions in the Hubbard model
• Probing many-body localization with neural networks
• Machine learning out-of-equilibrium phases of matter
• Machine learning for many-body physics: The case of the Anderson impurity model
• Unsupervised Learning of Frustrated Classical Spin Models I: Principle Component Analysis
• Pure density functional for strong correlations and the thermodynamic limit from machine learning
• Supervised Learning with Quantum-Inspired Tensor Networks
• Self-Learning Monte Carlo Method in Fermion Systems
• Parameter diagnostics of phases and phase transition learning by neural networks
• Finite-size scaling method for the Berezinskii-Kosterlitz-Thouless transition
• New ordered phases in a class of generalized XY models
• Applications of neural networks to the studies of phase transitions of two-dimensional Potts models
• Quantum phase recognition via unsupervised machine learning
• Can Boltzmann Machines Discover Cluster Updates ?
• Essential finite-size effect in the 2D XY model
• Competing nematic interactions in a generalized XY model in two and three dimensions
• Kosterlitz-Thouless and Potts transitions in a generalized XY model
• Cluster simulations of loop models on two-dimensional lattices
• Restricted Boltzmann Machines for the Long Range Ising Models
• Phase Diagrams of Three-Dimensional Anderson and Quantum Percolation Models using Deep Three-Dimensional Convolutional Neural Network
• Sampling algorithms for validation of supervised learning models for Ising-like systems
• Towards meaningful physics from generative models

Cited by in corpus (63)

• Topological quantum phase transitions retrieved through unsupervised machine learning
• Machine-Learning Studies on Spin Models
• Criticality and factorization in the Heisenberg chain with Dzyaloshinskii-Moriya interaction
• Machine Learning Holographic Mapping by Neural Network Renormalization Group
• Drawing Phase Diagrams of Random Quantum Systems by Deep Learning the Wave Functions
• Unsupervised learning of topological phase transitions using Calinski-Harabaz index
• Featureless adaptive optimization accelerates functional electronic materials design
• Supervised and unsupervised learning of directed percolation
• Topological Persistence Machine of Phase Transitions
• Machine-learning detection of the Berezinskii-Kosterlitz-Thouless transitions in the q-state clock models
• Unsupervised learning using topological data augmentation
• Absorbing phase transition with a continuously varying exponent in a quantum contact process: a neural network approach
• Machine learning of phase transitions in nonlinear polariton lattices
• Visualizing Quantum Phases And Identifying Quantum Phase Transitions By Nonlinear Dimensionality Reduction
• A Neural Networks study of the phase transitions of Potts model
• Learning quantum phase transitions through Topological Data Analysis
• Finite-size analysis in neural network classification of critical phenomena
• Transfer learning of phase transitions in percolation and directed percolation
• Markov Chain Monte Carlo Methods in Quantum Field Theories: A Modern Primer
• Unsupervised machine learning approaches to the $q$-state Potts model
• Machine-learning detection of the Berezinskii-Kosterlitz-Thouless transition and the second-order phase transition in the XXZ models
• Machine learning for percolation utilizing auxiliary Ising variables
• Machine learning generated configurations in presence of a conserved quantity: a cautionary tale
• Machine learning phases and criticalities without using real data for training
• Machine learning of XY model on a spherical Fibonacci lattice
• Supervised and Unsupervised Machine Learning of Structural Phases of Polymers Adsorbed to Nanowires
• The percolating cluster is invisible to image recognition with deep learning
• Unsupervised learning of phase transitions via modified anomaly detection with autoencoders
• Study of phase transition of Potts model with Domain Adversarial Neural Network
• Exponentially improved efficient machine learning for quantum many-body states with provable guarantees
• Learning phase transitions from regression uncertainty: A new regression-based machine learning approach for automated detection of phases of matter
• Machine learning phases of active matter
• Probing Criticality in Quantum Spin Chains with Neural Networks
• Unsupervised Machine Learning of Quenched Gauge Symmetries: A Proof-of-Concept Demonstration
• Phase determination with and without deep learning
• Direct detection of plasticity onset through total-strain profile evolution
• Machine learning of phases and structures for model systems in physics
• A learning algorithm with emergent scaling behavior for classifying phase transitions
• Deep Learning of Phase Transitions for Quantum Spin Chains from Correlation Aspects
• Machine learning phases of an Abelian gauge theory
• A simple framework for contrastive learning phases of matter
• Emergence of a finite-size-scaling function in the supervised learning of the Ising phase transition
• Unsupervised interpretable learning of topological indices invariant under permutations of atomic bands
• Robust Identification of Topological Phase Transition by Self-Supervised Machine Learning Approach
• Minimalist Neural Networks training for phase classification in diluted-Ising models
• Probing phase transitions with correlations in configuration space
• Machine Learning Percolation Model
• A sampling-guided unsupervised learning method to capture percolation in complex networks
• Machine learning classification of two-dimensional vortex configurations
• Quaternion-based machine learning on topological quantum systems
• Self-Supervised Ensemble Learning: A Universal Method for Phase Transition Classification of Many-Body Systems
• Exploring percolation phase transition in the three-dimensional Ising model with machine learning
• Berezinskii-Kosterlitz-Thouless Renormalization Group Flow at a Quantum Phase Transition
• Emergence of Brain Rhythms: Model Interpretation of EEG Data
• Discovering quasiorder parameters in the Potts model: A bridge between machine learning and critical phenomena
• A universal neural network for learning phases and criticalities
• Machine-Learning Detection of the Berezinskii-Kosterlitz-Thouless Transitions
• The statistical mechanics and machine learning of the $\alpha$-Rényi ensemble
• Machine learning of the Ising model on a spherical Fibonacci lattice
• Unsupervised classification of disordered patterns in an oppositely charged colloidal system
• Deep learning of thermodynamic laws from microscopic dynamics
• A Unsupervised Framework for Identifying Diverse Quantum Phase Transitions Using Classical Shadow Tomography
• Predicting parameters of a model cuprate superconductor using machine learning