Deriving pairwise transfer entropy from network structure and motifs

Abstract

Transfer entropy is an established method for quantifying directed statistical dependencies in neuroimaging and complex systems datasets. The pairwise (or bivariate) transfer entropy from a source to a target node in a network does not depend solely on the local source-target link weight, but on the wider network structure that the link is embedded in. This relationship is studied using a discrete-time linearly-coupled Gaussian model, which allows us to derive the transfer entropy for each link from the network topology. It is shown analytically that the dependence on the directed link weight is only a first approximation, valid for weak coupling. More generally, the transfer entropy increases with the in-degree of the source and decreases with the in-degree of the target, indicating an asymmetry of information transfer between hubs and low-degree nodes. In addition, the transfer entropy is directly proportional to weighted motif counts involving common parents or multiple walks from the source to the target, which are more abundant in networks with a high clustering coefficient than in random networks. Our findings also apply to Granger causality, which is equivalent to transfer entropy for Gaussian variables. Moreover, similar empirical results on random Boolean networks suggest that the dependence of the transfer entropy on the in-degree extends to nonlinear dynamics.

arXiv comment12 pages, 5 figures

References in corpus (14)

• Emergence of scaling in random networks
• Measuring Information Transfer
• Granger causality and transfer entropy are equivalent for Gaussian variables
• Structural Properties of the Caenorhabditis elegans Neuronal Network
• Control Principles of Complex Networks
• Local information transfer as a spatiotemporal filter for complex systems
• Model-free reconstruction of neuronal network connectivity from calcium imaging signals
• Causal Network Inference by Optimal Causation Entropy
• Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing
• IDTxl: The Information Dynamics Toolkit xl: a Python package for the efficient analysis of multivariate information dynamics in networks
• How structure sculpts function: unveiling the contribution of anatomical connectivity to the brain's spontaneous correlation structure
• Reconstructing Links in Directed Networks from Noisy Dynamics
• Solving the inverse problem of noise-driven dynamic networks
• A new method for choosing parameters in delay reconstruction-based forecast strategies

Cited by in corpus (3)

• Inferring network properties from time series using transfer entropy and mutual information: validation of multivariate versus bivariate approaches
• Analytic relationship of relative synchronizability to network structure and motifs
• Causally coherent structures in turbulent dynamical systems