Towards a Framework for Observational Causality From Time Series: When Shannon Meets Turing
arXiv:1909.13559 · doi:10.3390/e22040426
Abstract
We propose a novel tensor-based formalism for inferring causal structures from time series. An information theoretical analysis of transfer entropy, shows that transfer entropy results from transmission of information over a set of communication channels. Tensors are the mathematical equivalents of these multi-channel causal channels. A multi-channel causal channel is a generalization of a discrete memoryless channel. Investigation of a system comprising three variables shows that in our formalism, bivariate analysis suffices to differentiate between direct and indirect relations. For this to be true, we have to combine the output of multi-channel causal channels with the output of single-channel causal channels. We can understand this result when we consider the role of noise. Subsequent transmission of information over noisy channels can never result in less noisy transmission overall. This implies that a Data Processing Inequality exists for transfer entropy.
22 pages, 6 figures
References in corpus (8)
- Measuring Information Transfer
- ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context
- Nonnegative Decomposition of Multivariate Information
- A Survey of Learning Causality with Data: Problems and Methods
- Causal Network Inference by Optimal Causation Entropy
- Differentiating information transfer and causal effect
- Multivariate Dependence Beyond Shannon Information
- Using graph concepts to understand the organization of complex systems