Extending machine learning classification capabilities with histogram reweighting

Abstract

We propose the use of Monte Carlo histogram reweighting to extrapolate predictions of machine learning methods. In our approach, we treat the output from a convolutional neural network as an observable in a statistical system, enabling its extrapolation over continuous ranges in parameter space. We demonstrate our proposal using the phase transition in the two-dimensional Ising model. By interpreting the output of the neural network as an order parameter, we explore connections with known observables in the system and investigate its scaling behaviour. A finite size scaling analysis is conducted based on quantities derived from the neural network that yields accurate estimates for the critical exponents and the critical temperature. The method improves the prospects of acquiring precision measurements from machine learning in physical systems without an order parameter and those where direct sampling in regions of parameter space might not be possible.

References in corpus (54)

• Machine learning and the physical sciences
• Topological superconductors: a review
• Machine learning phases of matter
• The chiral and deconfinement aspects of the QCD transition
• Is there still any Tc mystery in lattice QCD? Results with physical masses in the continuum limit III
• Learning phase transitions by confusion
• Discovering Phase Transitions with Unsupervised Learning
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• Machine learning quantum phases of matter beyond the fermion sign problem
• Discovering Phases, Phase Transitions and Crossovers through Unsupervised Machine Learning: A critical examination
• Identifying topological order through unsupervised machine learning
• Learning Thermodynamics with Boltzmann Machines
• Machine Learning Phases of Strongly Correlated Fermions
• Self-Learning Monte Carlo Method
• Accelerate Monte Carlo Simulations with Restricted Boltzmann Machines
• Solving Statistical Mechanics Using Variational Autoregressive Networks
• Flow-based generative models for Markov chain Monte Carlo in lattice field theory
• Equivariant flow-based sampling for lattice gauge theory
• Machine learning vortices at the Kosterlitz-Thouless transition
• Detection of phase transition via convolutional neural network
• Unsupervised machine learning account of magnetic transitions in the Hubbard model
• Probing many-body localization with neural networks
• Machine learning out-of-equilibrium phases of matter
• Kernel methods for interpretable machine learning of order parameters
• Unsupervised Learning of Frustrated Classical Spin Models I: Principle Component Analysis
• Introductory lectures on lattice QCD at nonzero baryon number
• Asymptotically unbiased estimation of physical observables with neural samplers
• Regressive and generative neural networks for scalar field theory
• Machine Learning Many-Body Localization: Search for the Elusive Nonergodic Metal
• Parameter diagnostics of phases and phase transition learning by neural networks
• Self-learning Monte Carlo with Deep Neural Networks
• Probing hidden spin order with interpretable machine learning
• Self-Learning Determinantal Quantum Monte Carlo Method
• Extrapolating quantum observables with machine learning: Inferring multiple phase transitions from properties of a single phase
• Learning multiple order parameters with interpretable machines
• Self-Learning Monte Carlo Method: Continuous-Time Algorithm
• Learning phase transitions from dynamics
• Symmetry Enforced Self-Learning Monte Carlo Method Applied to the Holstein Model
• Machine Learning as a universal tool for quantitative investigations of phase transition
• Quantum phase recognition via unsupervised machine learning
• Principal Component Analysis for Fermionic Critical Points
• Designer Monte Carlo Simulation for Gross-Neveu Transition
• Interpretable Machine Learning Study of Many-Body Localization Transition in Disordered Quantum Ising Spin Chains
• Can Boltzmann Machines Discover Cluster Updates ?
• Self-learning Hybrid Monte Carlo: A First-principles Approach
• Interpretable machine learning for inferring the phase boundaries in a nonequilibrium system
• Machine learning dynamical phase transitions in complex networks
• Accelerating lattice quantum Monte Carlo simulation using artificial neural networks: an application to the Holstein model
• Projective quantum Monte Carlo simulations guided by unrestricted neural network states
• Extracting Critical Exponent by Finite-Size Scaling with Convolutional Neural Networks
• Self-learning projective quantum Monte Carlo simulations guided by restricted Boltzmann machines
• Self-learning Monte Carlo method with Behler-Parrinello neural networks
• Generation of ice states through deep reinforcement learning
• Accelerated Continuous time quantum Monte Carlo method with Machine Learning

Cited by in corpus (20)

• Phase Transitions in Particle Physics -- Results and Perspectives from Lattice Quantum Chromo-Dynamics
• Exploring QCD matter in extreme conditions with Machine Learning
• Gauge-equivariant flow models for sampling in lattice field theories with pseudofermions
• Unsupervised learning universal critical behavior via the intrinsic dimension
• Mapping distinct phase transitions to a neural network
• Quantum field-theoretic machine learning
• Machine-learning physics from unphysics: Finding deconfinement temperature in lattice Yang-Mills theories from outside the scaling window
• Quantitative analysis of phase transitions in two-dimensional XY models using persistent homology
• Inverse Renormalization Group in Quantum Field Theory
• Generalization capabilities of translationally equivariant neural networks
• Machine-learning detection of the Berezinskii-Kosterlitz-Thouless transition and the second-order phase transition in the XXZ models
• Adding machine learning within Hamiltonians: Renormalization group transformations, symmetry breaking and restoration
• Topological defects and confinement with machine learning: the case of monopoles in compact electrodynamics
• Unsupervised Learning of Rydberg Atom Array Phase Diagram with Siamese Neural Networks
• Quantum field theories, Markov random fields and machine learning
• Deep learning of phase transitions with minimal examples
• Machine learning with quantum field theories
• A universal neural network for learning phases and criticalities
• Machine-Learning Detection of the Berezinskii-Kosterlitz-Thouless Transitions
• Preserving gauge invariance in neural networks