Semantic information, autonomous agency, and nonequilibrium statistical physics
arXiv:1806.08053 · doi:10.1098/rsfs.2018.0041
Abstract
Shannon information theory provides various measures of so-called "syntactic information", which reflect the amount of statistical correlation between systems. In contrast, the concept of "semantic information" refers to those correlations which carry significance or "meaning" for a given system. Semantic information plays an important role in many fields, including biology, cognitive science, and philosophy, and there has been a long-standing interest in formulating a broadly applicable and formal theory of semantic information. In this paper we introduce such a theory. We define semantic information as the syntactic information that a physical system has about its environment which is causally necessary for the system to maintain its own existence. "Causal necessity" is defined in terms of counter-factual interventions which scramble correlations between the system and its environment, while "maintaining existence" is defined in terms of the system's ability to keep itself in a low entropy state. We also use recent results in nonequilibrium statistical physics to analyze semantic information from a thermodynamic point of view. Our framework is grounded in the intrinsic dynamics of a system coupled to an environment, and is applicable to any physical system, living or otherwise. It leads to formal definitions of several concepts that have been intuitively understood to be related to semantic information, including "value of information", "semantic content", and "agency".
References in corpus (47)
- Measuring Information Transfer
- Stochastic thermodynamics, fluctuation theorems, and molecular machines
- The Symbol Grounding Problem
- The information bottleneck method
- Generalized Jarzynski Equality under Nonequilibrium Feedback Control
- Second Law of Thermodynamics with Discrete Quantum Feedback Control
- Minimal Energy Cost for Thermodynamic Information Processing: Measurement and Information Erasure
- Second law and Landauer principle far from equilibrium
- The Three Faces of the Second Law: I. Master Equation Formulation
- Work and information processing in a solvable model of Maxwell's demon
- Experimental study of mutual information in a Maxwell Demon
- Local information transfer as a spatiotemporal filter for complex systems
- Information theory in molecular biology
- Nonequilibrium Thermodynamics of Feedback Control
- The Three Faces of the Second Law: II. Fokker-Planck Formulation
- Nonequilibrium Detailed Fluctuation Theorem for Repeated Discrete Feedback
- Information-theoretic approach to the study of control systems
- Probability currents as principal characteristics in the statistical mechanics of non-equilibrium steady states
- Information-Theoretic Limits of Control
- Thermodynamics of feedback controlled systems
- Information Thermodynamics on Causal Networks
- Maxwell's Refrigerator: An Exactly Solvable Model
- Second-law-like inequalities with information and their interpretations
- Thermodynamic Reversibility in Feedback Processes
- Thermodynamic and Logical Reversibilities Revisited
- Living is information processing: from molecules to global systems
- Stochastic thermodynamics for "Maxwell demon" feedbacks
- Generalized detailed Fluctuation Theorem under Nonequilibrium Feedback control
- An autonomous and reversible Maxwell's demon
- Thermodynamic efficiency of information and heat flow
- Generalising Landauer's Principle
- Fluctuation Theorems of Brownian Particles Controlled by a Maxwell's Demon
- Sensory capacity: an information theoretical measure of the performance of a sensor
- Transfer entropy in continuous time, with applications to jump and neural spiking processes
- The thermodynamic efficiency of computations made in cells across the range of life
- Multipartite information flow for multiple Maxwell demons
- Minimum energetic cost to maintain a target nonequilibrium state
- Justification of Logarithmic Loss via the Benefit of Side Information
- Entropy production and fluctuation theorems under feedback control: the molecular refrigerator model revisited
- Relations between Entropies Produced in Nondeterministic Thermodynamic Processes
- Thermodynamic aspects of information transfer in complex dynamical systems
- Coarse-graining and the Blackwell order
- A measure of the violation of the 'detailed balance' criterion: a possible definition of a 'distance' from equilibrium
- Extending Landauer's Bound from Bit Erasure to Arbitrary Computation
- Action and perception for spatiotemporal patterns
- Detecting emergent processes in cellular automata with excess information
- When is a bit worth much more than kT ln2?
Cited by in corpus (23)
- The dissipation-time uncertainty relation
- Thermodynamics of Chemical Waves
- Psychophysical identity and free energy
- Style-transfer and Paraphrase: Looking for a Sensible Semantic Similarity Metric
- Generative models as parsimonious descriptions of sensorimotor loops
- Quantum Cognitive Triad. Semantic geometry of context representation
- Semantic Information in a model of Resource Gathering Agents
- EXK-SC: A Semantic Communication Model Based on Information Framework Expansion and Knowledge Collision
- Nonequilibrium physics of brain dynamics
- Hybrid Life: Integrating Biological, Artificial, and Cognitive Systems
- Universal bounds on optimization of free energy harvesting
- Effective Communications for 6G: Challenges and Opportunities
- Decomposing information into copying versus transformation
- Thermodynamics of majority-logic decoding in information erasure
- Nonequilibrium thermodynamics of uncertain stochastic processes
- Semantic-Functional Communications in Cyber-Physical Systems
- Information-theoretic description of a feedback-control Kuramoto model
- Planetary Scale Information Transmission in the Biosphere and Technosphere: Limits and Evolution
- Rebuilding the Habitable Zone from the Bottom Up with Computational Zones
- Exo-Daisy World: Revisiting Gaia Theory through an Informational Architecture Perspective
- Information bounds production in replicator systems
- Work, entropy production, and thermodynamics of information under protocol constraints
- Information Transmission via Molecular Communication in Astrobiological Environments