Differentiating information transfer and causal effect

Abstract

The concepts of information transfer and causal effect have received much recent attention, yet often the two are not appropriately distinguished and certain measures have been suggested to be suitable for both. We discuss two existing measures, transfer entropy and information flow, which can be used separately to quantify information transfer and causal information flow respectively. We apply these measures to cellular automata on a local scale in space and time, in order to explicitly contrast them and emphasize the differences between information transfer and causality. We also describe the manner in which the measures are complementary, including the circumstances under which the transfer entropy is the best available choice to infer a causal effect. We show that causal information flow is a primary tool to describe the causal structure of a system, while information transfer can then be used to describe the emergent computation in the system.

8 pages, 2 figures

References in corpus (2)

• Local information transfer as a spatiotemporal filter for complex systems
• A framework for the local information dynamics of distributed computation in complex systems

Cited by in corpus (35)

• JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
• Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
• Efficient transfer entropy analysis of non-stationary neural time series
• Structure and causality relations in a global network of financial companies
• Bits from Biology for Computational Intelligence
• Causal interpretation rules for encoding and decoding models in neuroimaging
• Multivariate Dependence Beyond Shannon Information
• Transfer entropy in continuous time, with applications to jump and neural spiking processes
• Quantifying information transfer and mediation along causal pathways in complex systems
• A framework for the local information dynamics of distributed computation in complex systems
• Breakdown of local information processing may underlie isoflurane anesthesia effects
• Redundancy and synergy in dual decompositions of mutual information gain and information loss
• Towards a Synergy-based Approach to Measuring Information Modification
• The diminishing role of hubs in dynamical processes on complex networks
• Assessing the Significance of Directed and Multivariate Measures of Linear Dependence Between Time Series
• Learning in Feedforward Neural Networks Accelerated by Transfer Entropy
• Apparent remote synchronization of amplitudes: a demodulation and interference effect
• Unveiling causal activity of complex networks
• Information-theoretic analysis of the directional influence between cellular processes
• Estimating Conditional Transfer Entropy in Time Series using Mutual Information and Non-linear Prediction
• Measuring information transfer in a soft robotic arm
• Direct and Indirect Effects -- An Information Theoretic Perspective
• Information Fragmentation, Encryption and Information Flow in Complex Biological Networks
• Towards a Framework for Observational Causality From Time Series: When Shannon Meets Turing
• Can Transfer Entropy Infer Information Flow in Neuronal Circuits for Cognitive Processing?
• Coping with dating errors in causality estimation
• Brownian dynamics simulations of an idealized chemical reaction network under spatial confinement and crowding conditions
• Balanced Information Storage and Transfer in Modular Spiking Neural Networks
• Learning in Convolutional Neural Networks Accelerated by Transfer Entropy
• MERLiN: Mixture Effect Recovery in Linear Networks
• Recovery of non-linear cause-effect relationships from linearly mixed neuroimaging data
• Consensus between Epistemic Agents is Difficult
• Quantifying multivariate redundancy with maximum entropy decompositions of mutual information
• Information Plane Analysis Visualization in Deep Learning via Transfer Entropy
• Transfer Entropy: where Shannon meets Turing