Generalized Measures of Information Transfer

Abstract

Transfer entropy provides a general tool for analyzing the magnitudes and directions---but not the \emph{kinds}---of information transfer in a system. We extend transfer entropy in two complementary ways. First, we distinguish state-dependent from state-independent transfer, based on whether a source's influence depends on the state of the target. Second, for multiple sources, we distinguish between unique, redundant, and synergistic transfer. The new measures are demonstrated on several systems that extend examples from previous literature.

Cited by in corpus (16)

• JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
• A Bivariate Measure of Redundant Information
• Partial Information Decomposition as a Unified Approach to the Specification of Neural Goal Functions
• Information Flows? A Critique of Transfer Entropies
• Efficient transfer entropy analysis of non-stationary neural time series
• Expanding the Transfer Entropy to Identify Information Subgraphs in Complex Systems
• Bootstrap Methods for the Empirical Study of Decision-Making and Information Flows in Social Systems
• Breakdown of local information processing may underlie isoflurane anesthesia effects
• Redundancy and synergy in dual decompositions of mutual information gain and information loss
• A Graph Algorithmic Approach to Separate Direct from Indirect Neural Interactions
• Definition and properties to assess multi-agent environments as social intelligence tests
• Information encryption in the expert management of strategic uncertainty
• Quantifying multivariate redundancy with maximum entropy decompositions of mutual information
• Quantifying synergistic information remains an unsolved problem
• Information theoretic analysis of computational models as a tool to understand the neural basis of behaviors
• Learning Criticality in an Embodied Boltzmann Machine