Kernel methods for interpretable machine learning of order parameters

Abstract

Machine learning is capable of discriminating phases of matter, and finding associated phase transitions, directly from large data sets of raw state configurations. In the context of condensed matter physics, most progress in the field of supervised learning has come from employing neural networks as classifiers. Although very powerful, such algorithms suffer from a lack of interpretability, which is usually desired in scientific applications in order to associate learned features with physical phenomena. In this paper, we explore support vector machines (SVMs) which are a class of supervised kernel methods that provide interpretable decision functions. We find that SVMs can learn the mathematical form of physical discriminators, such as order parameters and Hamiltonian constraints, for a set of two-dimensional spin models: the ferromagnetic Ising model, a conserved-order-parameter Ising model, and the Ising gauge theory. The ability of SVMs to provide interpretable classification highlights their potential for automating feature detection in both synthetic and experimental data sets for condensed matter and other many-body systems.

8 pages, 6 figures

References in corpus (12)

• Learning phase transitions by confusion
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• Quantum Entanglement in Neural Network States
• Discovering Phases, Phase Transitions and Crossovers through Unsupervised Machine Learning: A critical examination
• Efficient Representation of Quantum Many-body States with Deep Neural Networks
• Self-Learning Monte Carlo Method
• Accelerate Monte Carlo Simulations with Restricted Boltzmann Machines
• Probing many-body localization with neural networks
• Deep Learning the Quantum Phase Transitions in Random Two-Dimensional Electron Systems
• Pure density functional for strong correlations and the thermodynamic limit from machine learning
• Restricted Boltzmann Machines for the Long Range Ising Models
• Reinforcement Learning Using Quantum Boltzmann Machines

Cited by in corpus (83)

• Machine Learning Topological Invariants with Neural Networks
• Approximating quantum many-body wave-functions using artificial neural networks
• Machine learning vortices at the Kosterlitz-Thouless transition
• Machine Learning of Explicit Order Parameters: From the Ising Model to SU(2) Lattice Gauge Theory
• Machine Learning for Quantum Matter
• Topological quantum phase transitions retrieved through unsupervised machine learning
• Deep Learning and AdS/CFT
• Machine Learning for Condensed Matter Physics
• Exploring QCD matter in extreme conditions with Machine Learning
• Unsupervised machine learning of topological phase transitions from experimental data
• Parameter diagnostics of phases and phase transition learning by neural networks
• Deep Learning Topological Invariants of Band Insulators
• Probing hidden spin order with interpretable machine learning
• Unsupervised identification of topological order using predictive models
• Discovering Symmetry Invariants and Conserved Quantities by Interpreting Siamese Neural Networks
• Learning multiple order parameters with interpretable machines
• Smallest Neural Network to Learn the Ising Criticality
• Unsupervised machine learning for detection of phase transitions in off-lattice systems I. Foundations
• Applications of neural networks to the studies of phase transitions of two-dimensional Potts models
• Machine Learning as a universal tool for quantitative investigations of phase transition
• Machine Learning of Frustrated Classical Spin Models. II. Kernel Principal Component Analysis
• Towards Novel Insights in Lattice Field Theory with Explainable Machine Learning
• Unsupervised machine learning for detection of phase transitions in off-lattice systems II. Applications
• Interpreting machine learning of topological quantum phase transitions
• Mapping distinct phase transitions to a neural network
• Unsupervised learning of topological phase transitions using Calinski-Harabaz index
• Interpretable Machine Learning Study of Many-Body Localization Transition in Disordered Quantum Ising Spin Chains
• Machine learning \& artificial intelligence in the quantum domain
• Interpretable machine learning for inferring the phase boundaries in a nonequilibrium system
• Neural network setups for a precise detection of the many-body localization transition: finite-size scaling and limitations
• Phase diagram study of a two-dimensional frustrated antiferromagnet via unsupervised machine learning
• Exploring neural network training strategies to determine phase transitions in frustrated magnetic models
• Machine-learning detection of the Berezinskii-Kosterlitz-Thouless transitions in the q-state clock models
• Reducing Autocorrelation Times in Lattice Simulations with Generative Adversarial Networks
• Extending machine learning classification capabilities with histogram reweighting
• Estimating the degree of non-Markovianity using machine learning
• Machine Learning Application to Two-Dimensional Dzyaloshinskii-Moriya Ferromagnets
• Extracting Critical Exponent by Finite-Size Scaling with Convolutional Neural Networks
• Revealing the Phase Diagram of Kitaev Materials by Machine Learning: Cooperation and Competition between Spin Liquids
• Phase Detection with Neural Networks: Interpreting the Black Box
• Few-shot machine learning in the three-dimensional Ising model
• Entanglement-guided architectures of machine learning by quantum tensor network
• Phase transition encoded in neural network
• Quantum kernels to learn the phases of quantum matter
• A Neural Networks study of the phase transitions of Potts model
• Identification of hidden order and emergent constraints in frustrated magnets using tensorial kernel methods
• Explainable automatic industrial carbon footprint estimation from bank transaction classification using natural language processing
• A machine learning approach to the Berezinskii-Kosterlitz-Thouless transition in classical and quantum models
• Machine-Learned Phase Diagrams of Generalized Kitaev Honeycomb Magnets
• KLLR: A scale-dependent, multivariate model class for regression analysis
• Hessian-based toolbox for reliable and interpretable machine learning in physics
• A learning by confusion approach to characterize phase transitions
• Replacing neural networks by optimal analytical predictors for the detection of phase transitions
• Machine-learning detection of the Berezinskii-Kosterlitz-Thouless transition and the second-order phase transition in the XXZ models
• Machine learning generated configurations in presence of a conserved quantity: a cautionary tale
• Machine learning phases and criticalities without using real data for training
• Optical lattice experiments at unobserved conditions and scales through generative adversarial deep learning
• Visualizing Neural Network Developing Perturbation Theory
• A Bayesian Inference Framework for Compression and Prediction of Quantum States
• Supervised and Unsupervised Machine Learning of Structural Phases of Polymers Adsorbed to Nanowires
• Observing a topological phase transition with deep neural networks from experimental images of ultracold atoms
• Exponentially improved efficient machine learning for quantum many-body states with provable guarantees
• Machine learning phase transitions of the three-dimensional Ising universality class
• Detecting composite orders in layered models via machine learning
• Unsupervised Machine Learning of Quenched Gauge Symmetries: A Proof-of-Concept Demonstration
• Dark soliton detection using persistent homology
• Unsupervised Learning of Rydberg Atom Array Phase Diagram with Siamese Neural Networks
• A learning algorithm with emergent scaling behavior for classifying phase transitions
• Emergence of a finite-size-scaling function in the supervised learning of the Ising phase transition
• Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives
• Interpretable Boosted Decision Tree Analysis for the Majorana Demonstrator
• Discovering conservation laws from trajectories via machine learning
• Learning What a Machine Learns in a Many-Body Localization Transition
• Machine learning the Ising transition: A comparison between discriminative and generative approaches
• Learning phases with Quantum Monte Carlo simulation cell
• Fluctuation based interpretable analysis scheme for quantum many-body snapshots
• Confusion-driven machine learning of structural phases of a flexible, magnetic Stockmayer polymer
• Exploring percolation phase transition in the three-dimensional Ising model with machine learning
• Randomized-gauge test for machine learning of Ising model order parameter
• Global exploration of phase behavior in frustrated Ising models using unsupervised learning techniques
• Machine-Learning Detection of the Berezinskii-Kosterlitz-Thouless Transitions
• Uncovering Magnetic Phases with Synthetic Data and Physics-Informed Training
• Interpretable representation learning of quantum data enabled by probabilistic variational autoencoders