High-Dimensional Independence Testing via Maximum and Average Distance Correlations
arXiv:2001.01095
Abstract
This paper investigates the utilization of maximum and average distance correlations for multivariate independence testing. We characterize their consistency properties in high-dimensional settings with respect to the number of marginally dependent dimensions, compare the advantages of each test statistic, examine their respective null distributions, and present a fast chi-square-based testing procedure. The resulting tests are non-parametric and applicable to both Euclidean distance and the Gaussian kernel as the underlying metric. To better understand the practical use cases of the proposed tests, we evaluate the empirical performance of the maximum distance correlation, average distance correlation, and the original distance correlation across various multivariate dependence scenarios, as well as conduct a real data experiment to test the presence of various cancer types and peptide levels in human plasma.
11 pages main + 5 pages appendix
References in corpus (9)
- Brownian distance covariance
- Equivalence of distance-based and RKHS-based statistics in hypothesis testing
- A consistent multivariate test of association based on ranks of distances
- DISCO analysis: A nonparametric extension of analysis of variance
- A fast algorithm for computing distance correlation
- Consistent distribution-free -sample and independence tests for univariate random variables
- Discovering and Deciphering Relationships Across Disparate Data Modalities
- The Exact Equivalence of Distance and Kernel Methods for Hypothesis Testing
- Community Correlations and Testing Independence Between Binary Graphs