Comparing large covariance matrices under weak conditions on the dependence structure and its application to gene clustering

Abstract

Comparing large covariance matrices has important applications in modern genomics, where scientists are often interested in understanding whether relationships (e.g., dependencies or co-regulations) among a large number of genes vary between different biological states. We propose a computationally fast procedure for testing the equality of two large covariance matrices when the dimensions of the covariance matrices are much larger than the sample sizes. A distinguishing feature of the new procedure is that it imposes no structural assumptions on the unknown covariance matrices. Hence the test is robust with respect to various complex dependence structures that frequently arise in genomics. We prove that the proposed procedure is asymptotically valid under weak moment conditions. As an interesting application, we derive a new gene clustering algorithm which shares the same nice property of avoiding restrictive structural assumptions for high-dimensional genomics data. Using an asthma gene expression dataset, we illustrate how the new test helps compare the covariance matrices of the genes across different gene sets/pathways between the disease group and the control group, and how the gene clustering algorithm provides new insights on the way gene clustering patterns differ between the two groups. The proposed methods have been implemented in an R-package HDtest and is available on CRAN.

The original title dated back to May 2015 is "Bootstrap Tests on High Dimensional Covariance Matrices with Applications to Understanding Gene Clustering"

References in corpus (3)

• A two-sample test for high-dimensional data with applications to gene-set testing
• Two sample tests for high-dimensional covariance matrices
• The asymptotic distribution and Berry--Esseen bound of a new test for independence in high dimension with an application to stochastic optimization

Cited by in corpus (11)

• Gaussian and bootstrap approximations for high-dimensional U-statistics and their applications
• Confidence regions for entries of a large precision matrix
• Testing High Dimensional Covariance Matrices, with Application to Detecting Schizophrenia Risk Genes
• A test of weak separability for multi-way functional data, with application to brain connectivity studies
• Central limit theorems for high dimensional dependent data
• Beyond Gaussian Approximation: Bootstrap for Maxima of Sums of Independent Random Vectors
• Testing the martingale difference hypothesis in high dimension
• Testing and Support Recovery of Correlation Structures for Matrix-Valued Observations with an Application to Stock Market Data
• Gaussian approximation for the sup-norm of high-dimensional matrix-variate U-statistics and its applications
• A Bootstrap Method for Error Estimation in Randomized Matrix Multiplication
• Compressed spectral screening for large-scale differential correlation analysis with application in selecting Glioblastoma gene modules