Kernel-based Conditional Independence Test and Application in Causal Discovery

Abstract

Conditional independence testing is an important problem, especially in Bayesian network learning and causal discovery. Due to the curse of dimensionality, testing for conditional independence of continuous variables is particularly challenging. We propose a Kernel-based Conditional Independence test (KCI-test), by constructing an appropriate test statistic and deriving its asymptotic distribution under the null hypothesis of conditional independence. The proposed method is computationally efficient and easy to implement. Experimental results show that it outperforms other methods, especially when the conditioning set is large or the sample size is not very large, in which case other methods encounter difficulties.

References in corpus (1)

• On the Identifiability of the Post-Nonlinear Causal Model

Cited by in corpus (9)

• Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information
• Forward-Backward Selection with Early Dropping
• On conditional parity as a notion of non-discrimination in machine learning
• SADA: A General Framework to Support Robust Causation Discovery with Theoretical Guarantee
• A Critical View of the Structural Causal Model
• A low variance consistent test of relative dependency
• A New Measure of Conditional Dependence
• Massively-Parallel Feature Selection for Big Data
• Fast Non-Parametric Tests of Relative Dependency and Similarity