Non-parametric learning critical behavior in Ising partition functions: PCA entropy and intrinsic dimension

Abstract

We provide and critically analyze a framework to learn critical behavior in classical partition functions through the application of non-parametric methods to data sets of thermal configurations. We illustrate our approach in phase transitions in 2D and 3D Ising models. First, we extend previous studies on the intrinsic dimension of 2D partition function data sets, by exploring the effect of volume in 3D Ising data. We find that as opposed to 2D systems for which this quantity has been successfully used in unsupervised characterizations of critical phenomena, in the 3D case its estimation is far more challenging. To circumvent this limitation, we then use the principal component analysis (PCA) entropy, a "Shannon entropy" of the normalized spectrum of the covariance matrix. We find a striking qualitative similarity to the thermodynamic entropy, which the PCA entropy approaches asymptotically. The latter allows us to extract -- through a conventional finite-size scaling analysis with modest lattice sizes -- the critical temperature with less than $1\%$ error for both 2D and 3D models while being computationally efficient. The PCA entropy can readily be applied to characterize correlations and critical phenomena in a huge variety of many-body problems and suggests a (direct) link between easy-to-compute quantities and entropies.

arXiv comment20 pages, 10 figures, Submission to SciPost. Comments are welcome

References in corpus (24)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Machine learning and the physical sciences
• Machine learning phases of matter
• A high-bias, low-variance introduction to Machine Learning for physicists
• Solving the 3D Ising Model with the Conformal Bootstrap
• Discovering Phase Transitions with Unsupervised Learning
• Computational Studies of Quantum Spin Systems
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• Estimating the intrinsic dimension of datasets by a minimal neighborhood information
• Discovering Phases, Phase Transitions and Crossovers through Unsupervised Machine Learning: A critical examination
• Density Matrix Renormalization Group Method for 2D Classical Models
• Unsupervised machine learning account of magnetic transitions in the Hubbard model
• Unsupervised Learning of Frustrated Classical Spin Models I: Principle Component Analysis
• Machine Learning for Condensed Matter Physics
• Controlling sign problems in spin models using tensor renormalization
• Universal and accessible entropy estimation using a compression algorithm
• Unsupervised learning universal critical behavior via the intrinsic dimension
• Machine-learning Iterative Calculation of Entropy for Physical Systems
• Intrinsic dimension of path integrals: data mining quantum criticality and emergent simplicity
• Few-shot machine learning in the three-dimensional Ising model
• Quantitative analysis of phase transitions in two-dimensional XY models using persistent homology
• Intrinsic dimension estimation for discrete metrics
• The geometry of hidden representations of large transformer models
• Entropy from Machine Learning

Cited by in corpus (6)

• An analysis of localization transitions using non-parametric unsupervised learning
• Network science Ising states of matter
• Principal component analysis of absorbing state phase transitions
• Supervised and unsupervised learning of the many-body critical phase, phase transitions, and critical exponents in disordered quantum systems
• Diagnosing quantum transport from wave function snapshots
• Family-Vicsek universality of the binary intrinsic dimension of nonequilibrium data