Information-theoretic bound on the energy cost of stochastic simulation
arXiv:1110.4217 · doi:10.1098/rspa.2012.0173
Abstract
Physical systems are often simulated using a stochastic computation where different final states result from identical initial states. Here, we derive the minimum energy cost of simulating a complex data set of a general physical system with a stochastic computation. We show that the cost is proportional to the difference between two information-theoretic measures of complexity of the data - the statistical complexity and the predictive information. We derive the difference as the amount of information erased during the computation. Finally, we illustrate the physics of information by implementing the stochastic computation as a Gedankenexperiment of a Szilard-type engine. The results create a new link between thermodynamics, information theory, and complexity.
arXiv comment5 pages, 1 figure
References in corpus (9)
- The Physics of Maxwell's demon and information
- Computational Mechanics: Pattern and Prediction, Structure and Simplicity
- Quantifying Self-Organization with Optimal Predictors
- Occam's Quantum Razor: How Quantum Mechanics can reduce the complexity of classical models
- Time's Barbed Arrow: Irreversibility, Crypticity, and Stored Information
- Statistical Complexity of Simple 1D Spin Systems
- What Is a Macrostate? Subjective Observations and Objective Dynamics
- Inferring hidden Markov models from noisy time sequences: a method to alleviate degeneracy in molecular dynamics
- Discovering Planar Disorder in Close-Packed Structures from X-Ray Diffraction: Beyond the Fault Model
Cited by in corpus (13)
- The thermodynamic efficiency of computations made in cells across the range of life
- Experimental quantum processing enhancement in modelling stochastic processes
- Dependence of dissipation on the initial distribution over states
- Thermodynamical cost of some interpretations of quantum theory
- Thermodynamic costs of Turing Machines
- Using quantum theory to reduce the complexity of input-output processes
- Thermodynamics of complexity and pattern manipulation
- Unbounded memory advantage in stochastic simulation using quantum mechanics
- Towards Quantifying Complexity with Quantum Mechanics
- Optimal high-level descriptions of dynamical systems
- The fundamental thermodynamic bounds on finite models
- Measuring complexity
- A computational mechanics approach to estimate entropy and (approximate) complexity for the dynamics of the 2D Ising Ferromagnet