Exchangeability, Conformal Prediction, and Rank Tests
arXiv:2005.06095
Abstract
Conformal prediction has been a very popular method of distribution-free predictive inference in recent years in machine learning and statistics. Its popularity stems from the fact that it works as a wrapper around any prediction algorithm such as neural networks or random forests. Exchangeability is at the core of the validity of conformal prediction. The concept of exchangeability is also at the core of rank tests widely known in nonparametric statistics. In this paper, we review the concept of exchangeability and discuss the implications for conformal prediction and rank tests. We provide a low-level introduction to these topics, and discuss the similarities between conformal prediction and rank tests.
arXiv commentAdded reference to Shi et al. (2020, JASA). Corrected Theorem 3
References in corpus (14)
- A Comparative Study of Efficient Initialization Methods for the K-Means Clustering Algorithm
- A tutorial on conformal prediction
- A survey of dimensionality reduction techniques
- Nonparametric Density Estimation for High-Dimensional Data - Algorithms and Applications
- Nested conformal prediction and quantile out-of-bag ensemble methods
- Conformalized Quantile Regression
- Consistent distribution-free -sample and independence tests for univariate random variables
- Adaptive, Distribution-Free Prediction Intervals for Deep Networks
- Fast Exact k-Means, k-Medians and Bregman Divergence Clustering in 1D
- Testing randomness
- A survey of dimensionality reduction techniques based on random projection
- Classification with Valid and Adaptive Coverage
- Flexible distribution-free conditional predictive bands using density estimators
- Selection and Aggregation of Conformal Prediction Sets