Measuring and testing dependence by correlation of distances

Abstract

Distance correlation is a new measure of dependence between random vectors. Distance covariance and distance correlation are analogous to product-moment covariance and correlation, but unlike the classical definition of correlation, distance correlation is zero only if the random vectors are independent. The empirical distance dependence measures are based on certain Euclidean distances between sample elements rather than sample moments, yet have a compact representation analogous to the classical covariance and correlation. Asymptotic properties and applications in testing independence are discussed. Implementation of the test and Monte Carlo results are also presented.

Published in at http://dx.doi.org/10.1214/009053607000000505 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Cited by in corpus (159)

• Detecting causal associations in large nonlinear time series datasets
• Brownian distance covariance
• Equivalence of distance-based and RKHS-based statistics in hypothesis testing
• A consistent multivariate test of association based on ranks of distances
• Distance covariance in metric spaces
• A consistent test of independence based on a sign covariance related to Kendall's tau
• Coupling Learning of Complex Interactions
• The fused Kolmogorov filter: A nonparametric model-free screening method
• Modern Data Analytics Approach to Predict Creep of High-Temperature Alloys
• Strong correlations between power-law growth of COVID-19 in four continents and the inefficiency of soft quarantine strategies
• Large-Scale Kernel Methods for Independence Testing
• Learning Disentangled Representations in the Imaging Domain
• COVID-19 second wave mortality in Europe and the United States
• The Chi-Square Test of Distance Correlation
• Variable selection for Naïve Bayes classification
• Variational Autoencoders for Anomalous Jet Tagging
• DisCo Fever: Robust Networks Through Distance Correlation
• Preparing for low surface brightness science with the Vera C. Rubin Observatory: characterisation of tidal features from mock images
• A fast algorithm for computing distance correlation
• Disentangle, align and fuse for multimodal and semi-supervised image segmentation
• An information theoretic framework for classifying exoplanetary system architectures
• ABCDisCo: Automating the ABCD Method with Machine Learning
• Estimation and testing for spatially indexed curves with application to ionospheric and magnetic field trends
• Fast robust correlation for high-dimensional data
• Non-stationary patterns of isolation-by-distance: inferring measures of local genetic differentiation with Bayesian kriging
• Distance Correlation Methods for Discovering Associations in Large Astrophysical Databases
• Discussion of: Brownian distance covariance
• From Distance Correlation to Multiscale Graph Correlation
• One-Hot Graph Encoder Embedding
• Correlation Sketches for Approximate Join-Correlation Queries
• The mRMR variable selection method: a comparative study for functional data
• COVID-19 in the United States: Trajectories and second surge behavior
• Variable selection in functional regression models: a review
• Learning Temporal Quantum Tomography
• Cluster-based dual evolution for multivariate time series: analyzing COVID-19
• BET on Independence
• Discovering and Deciphering Relationships Across Disparate Data Modalities
• Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
• The affinely invariant distance correlation
• Distance multivariance: New dependence measures for random vectors
• Asymptotic Distributions of High-Dimensional Distance Correlation Inference
• Association between COVID-19 cases and international equity indices
• A Cautionary Tale of Decorrelating Theory Uncertainties
• The Exact Equivalence of Distance and Kernel Methods for Hypothesis Testing
• Independence weights for causal inference with continuous treatments
• scikit-fda: A Python Package for Functional Data Analysis
• The DD${}^G$-classifier in the functional setting
• Intellectual and social similarity among scholarly journals: an exploratory comparison of the networks of editors, authors and co-citations
• Global and regional changes in carbon dioxide emissions: 1970-2019
• Causal Inference on Discrete Data via Estimating Distance Correlations
• Decay of distance autocorrelation and Lyapunov exponents
• Search for R-parity violating supersymmetry in a final state containing leptons and many jets with the ATLAS experiment using $\sqrt{s}=13$ TeV proton-proton collision data
• Spatio-temporal trends in the propagation and capacity of low-carbon hydrogen projects
• Quantum-classical transition and quantum activation of ratchet currents in the parameter space
• How relevant is the decision of containment measures against COVID-19 applied ahead of time?
• The Perfect Marriage and Much More: Combining Dimension Reduction, Distance Measures and Covariance
• On Quantifying Dependence: A Framework for Developing Interpretable Measures
• Distributional Modeling and Forecasting of Natural Gas Prices
• Optimal Renormalization Group Transformation from Information Theory
• Discussion of: Brownian distance covariance
• Similarity of Neural Network Models: A Survey of Functional and Representational Measures
• Estimating Feature-Label Dependence Using Gini Distance Statistics
• Estimating a continuously varying offset between multivariate time series with application to COVID-19 in the United States
• Identifying correlations between LIGO's astronomical range and auxiliary sensors using lasso regression
• Who are the gatekeepers of economics? Geographic diversity, gender composition, and interlocking editorship of journal boards
• Null Hypothesis Test for Anomaly Detection
• Four-hundred Very Metal-poor Stars Studied with LAMOST and Subaru. III. Dynamically Tagged Groups and Chemodynamical Properties
• Discussion of: Brownian distance covariance
• Data Compression and Inference in Cosmology with Self-Supervised Machine Learning
• In search of peak human athletic potential: A mathematical investigation
• Detecting independence of random vectors: generalized distance covariance and Gaussian covariance
• Generalized reliability based on distances
• Nonparametric Statistical Inference via Metric Distribution Function in Metric Spaces
• Tutorial: AI-assisted exploration and active design of polymers with high intrinsic thermal conductivity
• Geometric persistence and distributional trends in worldwide terrorism
• Search for heavy Higgs bosons with flavour-violating couplings in multi-lepton plus $b$-jets final states in $pp$ collisions at 13 TeV with the ATLAS detector
• Normative versus strategic accounts of acknowledgment data: the case of the top-five journals of economics
• Multivariate Pointwise Information-Driven Data Sampling and Visualization
• High-Resolution Peak Demand Estimation Using Generalized Additive Models and Deep Neural Networks
• Kernel k-Groups via Hartigan's Method
• USuRPER: Unit-Sphere Representation PERiodogram for full spectra
• Blind Determination of the Number of Sources Using Distance Correlation
• Enhancing searches for resonances with machine learning and moment decomposition
• Different coefficients for studying dependence
• Distance Correlation Coefficients for Lancaster Distributions
• GAN-AE : An anomaly detection algorithm for New Physics search in LHC data
• Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges
• Interpreting the Distance Correlation Results for the COMBO-17 Survey
• AMIC: An Adaptive Information Theoretic Method to Identify Multi-Scale Temporal Correlations in Big Time Series Data -- Accepted Version
• Ball: An R package for detecting distribution difference and association in metric spaces
• Distribution-free and Model-free Multivariate Feature Screening via Multivariate Rank Distance Correlation
• Statistical constraints on binary black hole inspiral dynamics
• Leveraging Digital Cousins for Ensemble Q-Learning in Large-Scale Wireless Networks
• New Periodograms Separating Orbital Radial Velocities and Spectral Shape Variation
• Compensation of phase drifts caused by ambient humidity, temperature and pressure changes for continuously operating interferometers
• Is a Classification Procedure Good Enough? A Goodness-of-Fit Assessment Tool for Classification Learning
• Data-Driven Representations for Testing Independence: Modeling, Analysis and Connection with Mutual Information Estimation
• Equivalence relations and $L^p$ distances between time series with application to the Black Summer Australian bushfires
• MM Algorithms for Distance Covariance based Sufficient Dimension Reduction and Sufficient Variable Selection
• Multi-Timescale Ensemble Q-learning for Markov Decision Process Policy Optimization
• Quantifying the Similarity of Planetary System Architectures
• Beyond Cuts in Small Signal Scenarios -- Enhanced Sneutrino Detectability Using Machine Learning
• The Kendall Interaction Filter for Variable Interaction Screening in Ultra High Dimensional Classification Problems
• Fine-grained classification of journal articles by relying on multiple layers of information through similarity network fusion: the case of the Cambridge Journal of Economics
• Universally Consistent K-Sample Tests via Dependence Measures
• Copula Index for Detecting Dependence and Monotonicity between Stochastic Signals
• Generative Adversarial Networks for geometric surfaces prediction in injection molding
• FLea: Addressing Data Scarcity and Label Skew in Federated Learning via Privacy-preserving Feature Augmentation
• FLea: Addressing Data Scarcity and Label Skew in Federated Learning via Privacy-preserving Feature Augmentation
• Clustering Multivariate Time Series using Energy Distance
• Entropy and type-token ratio in gigaword corpora
• MAPPING: Debiasing Graph Neural Networks for Fair Node Classification with Limited Sensitive Information Leakage
• Similarity matrix average for aggregating multiplex networks
• Correcting a Nonparametric Two-sample Graph Hypothesis Test for Graphs with Different Numbers of Vertices with Applications to Connectomics
• Nonparametric data segmentation in multivariate time series via joint characteristic functions
• Detection of Periodicity Based on Independence Tests - IV. Phase Distance Correlation Periodogram for Two-Dimensional Astrometry
• The FEDHC Bayesian network learning algorithm
• Discovering the Signal Subgraph: An Iterative Screening Approach on Graphs
• Distance Covariance, Independence, and Pairwise Differences
• Copula versions of distance multivariance and dHSIC via the distributional transform -- a general approach to construct invariant dependence measures
• Disentangling representations of retinal images with generative models
• MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation
• Strong Negative Type in Spheres
• A note on the equivalence between the conditional uncorrelation and the independence of random variables
• Network Dependence Testing via Diffusion Maps and Distance-Based Correlations
• Discovering Potential Correlations via Hypercontractivity
• A Consumer BCI for Automated Music Evaluation Within a Popular On-Demand Music Streaming Service - Taking Listener's Brainwaves to Extremes
• Uncertainty Quantification of Graph Convolution Neural Network Models of Evolving Processes
• A nonparametric test for elliptical distribution based on kernel embedding of probabilities
• Dependence and dependence structures: estimation and visualization using the unifying concept of distance multivariance
• Robust Independence Tests with Finite Sample Guarantees for Synchronous Stochastic Linear Systems
• Using Kernel-Based Statistical Distance to Study the Dynamics of Charged Particle Beams in Particle-Based Simulation Codes
• Discussion of: Brownian distance covariance
• Tests for validity of the semiparametric heteroskedastic transformation model
• Robust Distance Covariance
• Exploring language relations through syntactic distances and geographic proximity
• On a General Theoretical Framework of Reliability
• A Basic Treatment of the Distance Covariance
• Understanding the Perceived Quality of Video Predictions
• Siamese Learning-based Monarch Butterfly Localization
• Factor Importance Ranking and Selection using Total Indices
• Beyond the Veil of Similarity: Quantifying Semantic Continuity in Explainable AI
• Robust Sufficient Dimension Reduction via $\alpha$-Distance Covariance
• A search for dark matter produced in association with a dark Higgs boson decaying into a Higgs boson pair in 3$b$ or 4$b$ final states using $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector
• Deciphering galaxy images using machine vision -- Combining variational autoencoder and principal component analysis for feature extraction
• Quantification of collective behaviour via causality analysis
• Adaptation of the Phase Distance Correlation Periodogram to Account for Measurement Uncertainties
• Multiscale Comparative Connectomics
• Non-linear ICA based on Cramer-Wold metric
• fastMI: a fast and consistent copula-based estimator of mutual information
• Data driven background estimation in HEP using Generative Adversarial Networks
• Brownian forgery of statistical dependences
• MIMM-X: Disentangling Spurious Correlations for Medical Image Analysis
• A Subsampling-Based Method for Causal Discovery on Discrete Data
• TCMI: a non-parametric mutual-dependence estimator for multivariate continuous distributions
• Model Independent Periodogram for Scanning Astrometry
• Interpretation and visualization of distance covariance through additive decomposition of correlations formula
• Similarity network fusion for scholarly journals
• Comments on: A Gibbs sampler for a class of random convex polytopes