Optimal Renormalization Group Transformation from Information Theory

Abstract

Recently a novel real-space RG algorithm was introduced, identifying the relevant degrees of freedom of a system by maximizing an information-theoretic quantity, the real-space mutual information (RSMI), with machine learning methods. Motivated by this, we investigate the information theoretic properties of coarse-graining procedures, for both translationally invariant and disordered systems. We prove that a perfect RSMI coarse-graining does not increase the range of interactions in the renormalized Hamiltonian, and, for disordered systems, suppresses generation of correlations in the renormalized disorder distribution, being in this sense optimal. We empirically verify decay of those measures of complexity, as a function of information retained by the RG, on the examples of arbitrary coarse-grainings of the clean and random Ising chain. The results establish a direct and quantifiable connection between properties of RG viewed as a compression scheme, and those of physical objects i.e. Hamiltonians and disorder distributions. We also study the effect of constraints on the number and type of coarse-grained degrees of freedom on a generic RG procedure.

arXiv commentUpdated manuscript with new results on disordered systems

References in corpus (40)

• The World as a Hologram
• Topological entanglement entropy
• Measuring and testing dependence by correlation of distances
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Detecting topological order in a ground state wave function
• The holographic principle
• Machine learning phases of matter
• Thermodynamic limit of the density matrix renormalization for the spin-1 Heisenberg chain
• A class of quantum many-body states that can be efficiently simulated
• Local unitary transformation, long-range quantum entanglement, wave function renormalization, and topological order
• Learning phase transitions by confusion
• Discovering Phase Transitions with Unsupervised Learning
• Regularity Properties and Pathologies of Position-Space Renormalization-Group Transformations
• Perfect lattice action for asymptotically free theories
• Parameter Space Compression Underlies Emergent Theories and Predictive Models
• Learning Thermodynamics with Boltzmann Machines
• Equivalence of restricted Boltzmann machines and tensor network states
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Mutual Information, Neural Networks and the Renormalization Group
• Plaquette Boson-Fermion Model of Cuprates
• Neural Network Renormalization Group
• Singlet Excitations in Pyrochlore: A Study of Quantum Frustration
• Real Space Renormalization in Statistical Mechanics
• Renormalization of tensor networks using graph independent local truncations
• CORE Technology and Exact Hamiltonian Real-Space Renormalization Group Transformations
• Machine Learning Spatial Geometry from Entanglement Features
• Nonequilibrium dynamics of random field Ising spin chains: exact results via real space RG
• Field Theory Entropy, the $H$-theorem and the Renormalization Group
• Information geometric approach to the renormalisation group
• The renormalisation group via statistical inference
• Real Space Renormalization Group Theory of Disordered Models of Glasses
• Quantum Rate-Distortion Coding of Relevant Information
• Block Spins for Partial Differential Equations
• Renormalization group and perfect operators for stochastic differential equations
• Estimating the Mutual Information between two Discrete, Asymmetric Variables with Limited Samples
• Relative entropy in 2d Quantum Field Theory, finite-size corrections and irreversibility of the Renormalization Group
• Renormalization group maps for Ising models in lattice gas variables
• Majority Rule at Low Temperatures on the Square and Triangular Lattices
• Strong Disorder RG principles within a fixed cell-size real space renormalization : application to the Random Transverse Field Ising model on various fractal lattices
• A Real Space Renormalization Group Approach to Field Evolution Equations

Cited by in corpus (15)

• Machine Learning for Quantum Matter
• Machine Learning for Condensed Matter Physics
• Efficient Modelling of Trivializing Maps for Lattice ${\varphi }^4$ Theory Using Normalizing Flows: A First Look at Scalability
• Machine Learning Holographic Mapping by Neural Network Renormalization Group
• Deep learning black hole metrics from shear viscosity
• Statistical physics through the lens of real-space mutual information
• Relevance in the Renormalization Group and in Information Theory
• Symmetries and phase diagrams with real-space mutual information neural estimation
• Neural Monte Carlo Renormalization Group
• RG-Flow: A hierarchical and explainable flow model based on renormalization group and sparse prior
• Bayesian RG Flow in Neural Network Field Theories
• Dreaming up scale invariance via inverse renormalization group
• Minimizing couplings in renormalization by preserving short-range mutual information
• Application of deep neural networks for computing the renormalization group flow of the two-dimensional phi^4 field theory
• Gaussian Information Bottleneck and the Non-Perturbative Renormalization Group