Autonomous Discovery of the Ising Model's Critical Parameters with Reinforcement Learning

Abstract

Traditional methods for determining critical parameters are often influenced by human factors. This research introduces a physics-inspired adaptive reinforcement learning framework that enables agents to autonomously interact with physical environments, simultaneously identifying both the critical temperature and various types of critical exponents in the Ising model with precision. Interestingly, our algorithm exhibits search behavior reminiscent of phase transitions, efficiently converging to target parameters regardless of initial conditions. Experimental results demonstrate that this method significantly outperforms traditional approaches, particularly in environments with strong perturbations. This study not only incorporates physical concepts into machine learning to enhance algorithm interpretability but also establishes a new paradigm for scientific exploration, transitioning from manual analysis to autonomous AI discovery.

37 pages, 9 figures. This is the Accepted Manuscript of an article published in J. Stat. Mech

References in corpus (15)

• Machine learning phases of matter
• Learning phase transitions by confusion
• Machine Learning Phases of Strongly Correlated Fermions
• A Measure of data-collapse for scaling
• Parameter diagnostics of phases and phase transition learning by neural networks
• Critical Binder cumulant of two-dimensional Ising models
• Thermodynamics and Feature Extraction by Machine Learning
• Topological order and entanglement dynamics in the measurement-only XZZX quantum code
• Interpretable Machine Learning Study of Many-Body Localization Transition in Disordered Quantum Ising Spin Chains
• Unsupervised learning of topological phase transitions using Calinski-Harabaz index
• Neural network setups for a precise detection of the many-body localization transition: finite-size scaling and limitations
• Extracting Critical Exponent by Finite-Size Scaling with Convolutional Neural Networks
• Percolation of Vortices in the 3D Abelian Lattice Higgs Model
• Few-shot machine learning in the three-dimensional Ising model
• Neural Network Approach to Scaling Analysis of Critical Phenomena