Misanthropic Entropy and Renormalization as a Communication Channel
arXiv:2108.02772 · doi:10.1142/S0217751X22501093
Abstract
A central physical question is the extent to which infrared (IR) observations are sufficient to reconstruct a candidate ultraviolet (UV) completion. We recast this question as a problem of communication, with messages encoded in field configurations of the UV being transmitted to the IR degrees of freedom via a noisy channel specified by renormalization group (RG) flow, with noise generated by coarse graining / decimation. We present an explicit formulation of these considerations in terms of lattice field theory, where we show that the "misanthropic entropy" -- the mutual information obtained from decimating neighbors -- encodes the extent to which information is lost in marginalizing over / tracing out UV degrees of freedom. Our considerations apply both to statistical field theories as well as density matrix renormalization of quantum systems, where in the quantum case, the statistical field theory analysis amounts to a leading order approximation. As a concrete example, we focus on the case of the 2D Ising model, where we show that the misanthropic entropy detects the onset of the phase transition at the Ising model critical point.
arXiv commentv2: 19 pages, 6 figures, references added, figure added, clarifications added
References in corpus (23)
- Gaussian Quantum Information
- The information bottleneck method
- Eternal Black Holes in AdS
- Entanglement Renormalization and Holography
- An exact mapping between the Variational Renormalization Group and Deep Learning
- Quantum MERA Channels
- Neural Networks and Quantum Field Theory
- Multi-scale structural complexity of natural patterns
- Quantum Criticality and the Kondo Lattice
- Making Almost Commuting Matrices Commute
- Coarse Grained Quantum Dynamics
- Nonperturbative renormalization for the neural network-QFT correspondence
- Information geometry in quantum field theory: lessons from simple examples
- Almost commuting matrices with respect to normalized Hilbert-Schmidt norm
- Statistical coupling constants from hidden sector entanglement
- Quantum Mechanics in the Infrared
- The Ultraviolet Structure of Quantum Field Theories. Part 2: What is Quantum Field Theory?
- The Ultraviolet Structure of Quantum Field Theories. Part 3: Gauge Theories
- The Ultraviolet Structure of Quantum Field Theories. Part 1: Quantum Mechanics
- Statistical Inference, Occam's Razor and Statistical Mechanics on The Space of Probability Distributions
- MCMC with Strings and Branes: The Suburban Algorithm
- Infinite Distance Limits and Information Theory
- MCMC with Strings and Branes: The Suburban Algorithm (Extended Version)