Comparing the Pearson and Spearman Correlation Coefficients Across Distributions and Sample Sizes: A Tutorial Using Simulations and Empirical Data

Abstract

The Pearson product-moment correlation coefficient (rp) and the Spearman rank correlation coefficient (rs) are widely used in psychological research. We compare rp and rs on 3 criteria: variability, bias with respect to the population value, and robustness to an outlier. Using simulations across low (N = 5) to high (N = 1,000) sample sizes we show that, for normally distributed variables, rp and rs have similar expected values but rs is more variable, especially when the correlation is strong. However, when the variables have high kurtosis, rp is more variable than rs. Next, we conducted a sampling study of a psychometric dataset featuring symmetrically distributed data with light tails, and of 2 Likert-type survey datasets, 1 with light-tailed and the other with heavy-tailed distributions. Consistent with the simulations, rp had lower variability than rs in the psychometric dataset. In the survey datasets with heavy-tailed variables in particular, rs had lower variability than rp, and often corresponded more accurately to the population Pearson correlation coefficient (Rp) than rp did. The simulations and the sampling studies showed that variability in terms of standard deviations can be reduced by about 20% by choosing rs instead of rp. In comparison, increasing the sample size by a factor of 2 results in a 41% reduction of the standard deviations of rs and rp. In conclusion, rp is suitable for light-tailed distributions, whereas rs is preferable when variables feature heavy-tailed distributions or when outliers are present, as is often the case in psychological research.

References in corpus (1)

• The On-Line Encyclopedia of Integer Sequences

Cited by in corpus (15)

• k-Nearest Neighbour Classifiers: 2nd Edition (with Python examples)
• Correlation Sketches for Approximate Join-Correlation Queries
• Seismic Facies Analysis: A Deep Domain Adaptation Approach
• Well Googled is Half Done: Multimodal Forecasting of New Fashion Product Sales with Image-based Google Trends
• Instance Space Analysis of Search-Based Software Testing
• Explainable machine learning multi-label classification of Spanish legal judgements
• Dynamics of Fecal Coliform Bacteria along Canada's Coast
• Interpretable classification of wiki-review streams
• Comparison of correlation-based measures of concordance in terms of asymptotic variance
• How balance and sample size impact bias in the estimation of causal treatment effects: A simulation study
• Exploring the Interplay Between Voice, Personality, and Gender in Human-Agent Interactions
• General Confidentiality and Utility Metrics for Privacy-Preserving Data Publishing Based on the Permutation Model
• Optimal word order for non-causal text generation with Large Language Models: the Spanish case
• PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilities
• Tool Choice Matters: Evaluating edgeR vs. DESeq2 for Sensitivity, Robustness, and Cross-Study Performance