A Framework for Causal Discovery in non-intervenable systems

Abstract

Many frameworks exist to infer cause and effect relations in complex nonlinear systems but a complete theory is lacking. A new framework is presented that is fully nonlinear, provides a complete information theoretic disentanglement of causal processes, allows for nonlinear interactions between causes, identifies the causal strength of missing or unknown processes, and can analyze systems that cannot be represented on Directed Acyclic Graphs. The basic building blocks are information theoretic measures such as (conditional) mutual information and a new concept called certainty that monotonically increases with the information available about the target process. The framework is presented in detail and compared with other existing frameworks, and the treatment of confounders is discussed. While there are systems with structures that the framework cannot disentangle, it is argued that any causal framework that is based on integrated quantities will miss out potentially important information of the underlying probability density functions. The framework is tested on several highly simplified stochastic processes to demonstrate how blocking and gateways are handled, and on the chaotic Lorentz 1963 system. We show that the framework provides information on the local dynamics, but also reveals information on the larger scale structure of the underlying attractor. Furthermore, by applying it to real observations related to the El-Nino-Southern-Oscillation system we demonstrate its power and advantage over other methodologies.

arXiv comment45 pages, 9 figures

References in corpus (15)

• Measuring Information Transfer
• Estimating Mutual Information
• Quantifying unique information
• Causal Effect Inference with Deep Latent-Variable Models
• Nonnegative Decomposition of Multivariate Information
• Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
• A Survey of Learning Causality with Data: Problems and Methods
• Causal Network Inference by Optimal Causation Entropy
• A Bivariate Measure of Redundant Information
• Information Flows? A Critique of Transfer Entropies
• Intersection Information based on Common Randomness
• Multivariate Dependence Beyond Shannon Information
• Quantifying information transfer and mediation along causal pathways in complex systems
• Minimal sufficient causation and directed acyclic graphs
• Bayesian Symbolic Regression