Integrated information as a common signature of dynamical and information-processing complexity

Abstract

The apparent dichotomy between information-processing and dynamical approaches to complexity science forces researchers to choose between two diverging sets of tools and explanations, creating conflict and often hindering scientific progress. Nonetheless, given the shared theoretical goals between both approaches, it is reasonable to conjecture the existence of underlying common signatures that capture interesting behaviour in both dynamical and information-processing systems. Here we argue that a pragmatic use of Integrated Information Theory (IIT), originally conceived in theoretical neuroscience, can provide a potential unifying framework to study complexity in general multivariate systems. Furthermore, by leveraging metrics put forward by the integrated information decomposition ($\Phi$ID) framework, our results reveal that integrated information can effectively capture surprisingly heterogeneous signatures of complexity -- including metastability and criticality in networks of coupled oscillators as well as distributed computation and emergent stable particles in cellular automata -- without relying on idiosyncratic, ad-hoc criteria. These results show how an agnostic use of IIT can provide important steps towards bridging the gap between informational and dynamical approaches to complex systems.

References in corpus (19)

• Measuring Information Transfer
• Chimera states: Coexistence of coherence and incoherence in networks of coupled oscillators
• Metastable Chimera States in Community-Structured Oscillator Networks
• Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
• Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Information
• A unified framework for information integration based on information geometry
• Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate data
• Measuring multivariate redundant information with pointwise common change in surprisal
• Measuring Integrated Information: Comparison of Candidate Measures in Theory and Simulation
• Anatomy of a Bit: Information in a Time Series Observation
• Pointwise Partial Information Decomposition using the Specificity and Ambiguity Lattices
• The signatures of conscious access and phenomenology are consistent with large-scale brain communication at criticality
• The Phi measure of integrated information is not well-defined for general physical systems
• An information-theoretic approach to self-organisation: Emergence of complex interdependencies in coupled dynamical systems
• Beyond integrated information: A taxonomy of information dynamics phenomena
• Computation and Universality: Class IV versus Class III Cellular Automata
• Fraudulent White Noise: Flat power spectra belie arbitrarily complex processes
• Complexity as Causal Information Integration
• Balanced Information Storage and Transfer in Modular Spiking Neural Networks

Cited by in corpus (7)

• Towards an extended taxonomy of information dynamics via Integrated Information Decomposition
• Decomposing past and future: Integrated information decomposition based on shared probability mass exclusions
• Early warning indicators via latent stochastic dynamical systems
• Integrated Information Decomposition Unveils Major Structural Traits of $In$ $Silico$ and $In$ $Vitro$ Neuronal Networks
• Dynamical Phases and Resonance Phenomena in Information-Processing Recurrent Neural Networks
• Outsourcing Control requires Control Complexity
• How Morphological Computation shapes Integrated Information in Embodied Agents