Quantifying Causal Coupling Strength: A Lag-specific Measure For Multivariate Time Series Related To Transfer Entropy

Abstract

While it is an important problem to identify the existence of causal associations between two components of a multivariate time series, a topic addressed in Runge et al. (2012), it is even more important to assess the strength of their association in a meaningful way. In the present article we focus on the problem of defining a meaningful coupling strength using information theoretic measures and demonstrate the short-comings of the well-known mutual information and transfer entropy. Instead, we propose a certain time-delayed conditional mutual information, the momentary information transfer (MIT), as a measure of association that is general, causal and lag-specific, reflects a well interpretable notion of coupling strength and is practically computable. MIT is based on the fundamental concept of source entropy, which we utilize to yield a notion of coupling strength that is, compared to mutual information and transfer entropy, well interpretable, in that for many cases it solely depends on the interaction of the two components at a certain lag. In particular, MIT is thus in many cases able to exclude the misleading influence of autodependency within a process in an information-theoretic way. We formalize and prove this idea analytically and numerically for a general class of nonlinear stochastic processes and illustrate the potential of MIT on climatological data.

15 pages, 6 figures; accepted for publication in Physical Review E

References in corpus (2)

• Granger causality and transfer entropy are equivalent for Gaussian variables
• Kernel method for nonlinear Granger causality

Cited by in corpus (30)

• Detecting causal associations in large nonlinear time series datasets
• Complex network approaches to nonlinear time series analysis
• HERMES: towards an integrated toolbox to characterize functional and effective brain connectivity
• Causal Network Inference by Optimal Causation Entropy
• Normalizing the causality between time series
• Direct coupling information measure from non-uniform embedding
• Unified functional network and nonlinear time series analysis for complex systems science: The pyunicorn package
• Disentangling different types of El Niño episodes by evolving climate network analysis
• Complex network based techniques to identify extreme events and (sudden) transitions in spatio-temporal systems
• Quantifying information transfer and mediation along causal pathways in complex systems
• How complex climate networks complement eigen techniques for the statistical analysis of climatological data
• Identifying Coupling Structure in Complex Systems through the Optimal Causation Entropy Principle
• Optimal model-free prediction from multivariate time series
• Understanding causation via correlations and linear response theory
• Assessing directionality and strength of coupling through symbolic analysis: an application to epilepsy patients
• Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasets
• Hierarchical structures in Northern Hemispheric extratropical winter ocean-atmosphere interactions
• Causation entropy from symbolic representations of dynamical systems
• Reconstructing regime-dependent causal relationships from observational time series
• Identifying delayed directional couplings with symbolic transfer entropy
• On entropy, entropy-like quantities, and applications
• Measuring topological descriptors of complex networks under uncertainty
• Measuring information transfer in a soft robotic arm
• Quantitative assessment of drivers of recent climate variability: An information theoretic approach
• Entropic Causal Inference for Neurological Applications
• Complex systems: features, similarity and connectivity
• On the graph-theoretical interpretation of Pearson correlations in a multivariate process and a novel partial correlation measure
• Effective phase connectivity from observations
• Assimilative Causal Inference
• Comment on Wibral et al. (2013): Measuring information-transfer delays, PloS ONE 8(2): e55809