Causal learning with sufficient statistics: an information bottleneck approach

Abstract

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional independencies between variables of a system are common tools for this purpose, but are limited in the lack of independencies. To surmount this limitation, we capitalize on the fact that the laws governing the generative mechanisms of a system often result in substructures embodied in the generative functional equation of a variable, which act as sufficient statistics for the influence that other variables have on it. These functional sufficient statistics constitute intermediate hidden variables providing new conditional independencies to be tested. We propose to use the Information Bottleneck method, a technique commonly applied for dimensionality reduction, to find underlying sufficient sets of statistics. Using these statistics we formulate new additional rules of causal orientation that provide causal information not obtainable from standard structure learning algorithms, which exploit only conditional independencies between observable variables. We validate the use of sufficient statistics for structure learning both with simulated systems built to contain specific sufficient statistics and with benchmark data from regulatory rules previously and independently proposed to model biological signal transduction networks.

References in corpus (5)

• Predicting essential components of signal transduction networks: a dynamic model of guard cell abscisic acid signaling
• On the Identifiability of the Post-Nonlinear Causal Model
• Causal Inference in the Presence of Latent Variables and Selection Bias
• Causal graphical models in systems genetics: A unified framework for joint inference of causal network and genetic architecture for correlated phenotypes
• Constraint-based Causal Discovery from Multiple Interventions over Overlapping Variable Sets

Cited by in corpus (1)

• Learning Conditional Invariance through Cycle Consistency