Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate data

Abstract

The broad concept of emergence is instrumental in various of the most challenging open scientific questions -- yet, few quantitative theories of what constitutes emergent phenomena have been proposed. This article introduces a formal theory of causal emergence in multivariate systems, which studies the relationship between the dynamics of parts of a system and macroscopic features of interest. Our theory provides a quantitative definition of downward causation, and introduces a complementary modality of emergent behaviour -- which we refer to as causal decoupling. Moreover, the theory allows practical criteria that can be efficiently calculated in large systems, making our framework applicable in a range of scenarios of practical interest. We illustrate our findings in a number of case studies, including Conway's Game of Life, Reynolds' flocking model, and neural activity as measured by electrocorticography.

arXiv comment18 pages, 7 figures

References in corpus (18)

• Estimating Mutual Information
• JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
• Nonnegative Decomposition of Multivariate Information
• Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
• Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Information
• Measuring multivariate redundant information with pointwise common change in surprisal
• Measuring Integrated Information: Comparison of Candidate Measures in Theory and Simulation
• Inferring collective dynamical states from widely unobserved systems
• When the map is better than the territory
• Information Closure Theory of Consciousness
• The Phi measure of integrated information is not well-defined for general physical systems
• An information-theoretic approach to self-organisation: Emergence of complex interdependencies in coupled dynamical systems
• An operational information decomposition via synergistic disclosure
• Beyond integrated information: A taxonomy of information dynamics phenomena
• An Information Criterion for Inferring Coupling in Distributed Dynamical Systems
• Integrated information and dimensionality in continuous attractor dynamics
• Toy Models of Top Down Causation
• Modes of Information Flow

Cited by in corpus (24)

• Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
• Integrated information as a common signature of dynamical and information-processing complexity
• A Novel Approach to the Partial Information Decomposition
• Dynamical independence: discovering emergent macroscopic processes in complex dynamical systems
• Towards an extended taxonomy of information dynamics via Integrated Information Decomposition
• Decomposing past and future: Integrated information decomposition based on shared probability mass exclusions
• Quantifying high-order interdependencies on individual patterns via the local O-information: theory and applications to music analysis
• Neural Information Squeezer for Causal Emergence
• Flickering emergences: The question of locality in information-theoretic approaches to emergence
• Emergence and algorithmic information dynamics of systems and observers
• Finding emergence in data by maximizing effective information
• An information-theoretic approach to hypergraph psychometrics
• A generalization of the maximum entropy principle for curved statistical manifolds
• Duality between predictability and reconstructability in complex systems
• Simultaneity of consciousness with physical reality: the key that unlocks the mind-matter problem
• Human Perception of Intrinsically Motivated Autonomy in Human-Robot Interaction
• Integrated Information Decomposition Unveils Major Structural Traits of $In$ $Silico$ and $In$ $Vitro$ Neuronal Networks
• An Exact Theory of Causal Emergence for Linear Stochastic Iteration Systems
• Explicit Formula for Partial Information Decomposition
• Inference of time-ordered multibody interactions
• On Information Links
• Multivariate Partial Information Decomposition: Constructions, Inconsistencies, and Alternative Measures
• Intersectional synergies: untangling irreducible effects of intersecting identities via information decomposition
• SVD-based Causal Emergence for Gaussian Iterative Systems