The thermodynamics of prediction

Abstract

A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictive power, and thus represents the ineffectiveness of the model. We expose the fundamental equivalence between this model inefficiency and thermodynamic inefficiency, measured by dissipation. Our results hold arbitrarily far from thermodynamic equilibrium and are applicable to a wide range of systems, including biomolecular machines. They highlight a profound connection between the effective use of information and efficient thermodynamic operation: any system constructed to keep memory about its environment and to operate with maximal energetic efficiency has to be predictive.

5 pages, 1 figure

References in corpus (2)

• Work and heat probability distribution of an optically driven Brownian particle: Theory and experiments
• Beyond Boltzmann-Gibbs statistics: Maximum entropy hyperensembles out-of-equilibrium

Cited by in corpus (13)

• Thermodynamic costs of information processing in sensory adaption
• Efficiency of cellular information processing
• The geometry of thermodynamic control
• Thermodynamics of statistical inference by cells
• Stochastic thermodynamics with information reservoirs
• The Emerging Energy Web
• Optimal high-level descriptions of dynamical systems
• Thermodynamic Computing
• Stochastic thermodynamics of interacting degrees of freedom: Fluctuation theorems for detached path probabilities
• Foundations of Stochastic Thermodynamics
• Dissipation in non-steady state regulatory circuits
• On the thermodynamics of prediction under dissipative adaptation
• A Non-equilibrium Thermodynamic Framework of Consciousness