Decomposing past and future: Integrated information decomposition based on shared probability mass exclusions

Abstract

A core feature of complex systems is that the interactions between elements in the present causally constrain each-other as the system evolves through time. To fully model all of these interactions (between elements, as well as ensembles of elements), we can decompose the total information flowing from past to future into a set of non-overlapping temporal interactions that describe all the different modes by which information can flow. To achieve this, we propose a novel information-theoretic measure of temporal dependency ($I_{\tau sx}$) based on informative and misinformative local probability mass exclusions. To demonstrate the utility of this framework, we apply the decomposition to spontaneous spiking activity recorded from dissociated neural cultures of rat cerebral cortex to show how different modes of information processing are distributed over the system. Furthermore, being a localizable analysis, we show that $I_{\tau sx}$ can provide insight into the computational structure of single moments. We explore the time-resolved computational structure of neuronal avalanches and find that different types of information atoms have distinct profiles over the course of an avalanche, with the majority of non-trivial information dynamics happening before the first half of the cascade is completed. These analyses allow us to move beyond the historical focus on single measures of dependency such as information transfer or information integration, and explore a panoply of different relationships between elements (and groups of elements) in complex systems.

arXiv comment19 pages, 8 figures

References in corpus (21)

• JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
• Quantifying unique information
• Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
• Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Information
• A Bivariate Measure of Redundant Information
• Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate data
• Measuring multivariate redundant information with pointwise common change in surprisal
• Anatomy of a Bit: Information in a Time Series Observation
• IDTxl: The Information Dynamics Toolkit xl: a Python package for the efficient analysis of multivariate information dynamics in networks
• Intersection Information based on Common Randomness
• Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems
• Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
• Pointwise Partial Information Decomposition using the Specificity and Ambiguity Lattices
• Integrated information as a common signature of dynamical and information-processing complexity
• Introducing a differentiable measure of pointwise shared information
• An operational information decomposition via synergistic disclosure
• Quantifying synergistic information using intermediate stochastic variables
• Unique Information and Secret Key Agreement
• Generalised Measures of Multivariate Information Content
• Flickering emergences: The question of locality in information-theoretic approaches to emergence
• Probability Mass Exclusions and the Directed Components of Pointwise Mutual Information

Cited by in corpus (2)

• Flickering emergences: The question of locality in information-theoretic approaches to emergence
• Integrated Information Decomposition Unveils Major Structural Traits of $In$ $Silico$ and $In$ $Vitro$ Neuronal Networks