Regression Conformal Prediction with Nearest Neighbours

Abstract

In this paper we apply Conformal Prediction (CP) to the k-Nearest Neighbours Regression (k-NNR) algorithm and propose ways of extending the typical nonconformity measure used for regression so far. Unlike traditional regression methods which produce point predictions, Conformal Predictors output predictive regions that satisfy a given confidence level. The regions produced by any Conformal Predictor are automatically valid, however their tightness and therefore usefulness depends on the nonconformity measure used by each CP. In effect a nonconformity measure evaluates how strange a given example is compared to a set of other examples based on some traditional machine learning algorithm. We define six novel nonconformity measures based on the k-Nearest Neighbours Regression algorithm and develop the corresponding CPs following both the original (transductive) and the inductive CP approaches. A comparison of the predictive regions produced by our measures with those of the typical regression measure suggests that a major improvement in terms of predictive region tightness is achieved by the new measures.

References in corpus (1)

• Regression Conformal Prediction with Nearest Neighbours

Cited by in corpus (23)

• Big-Data Science in Porous Materials: Materials Genomics and Machine Learning
• Conformal Prediction: a Unified Review of Theory and New Challenges
• Regression Conformal Prediction with Nearest Neighbours
• A review of predictive uncertainty estimation with machine learning
• Reliable Prediction Intervals with Regression Neural Networks
• Well-calibrated Confidence Measures for Multi-label Text Classification with a Large Number of Labels
• Valid prediction intervals for regression problems
• A comparison of some conformal quantile regression methods
• Conformalized Quantile Regression
• Automated Ensemble Multimodal Machine Learning for Healthcare
• Guaranteed Coverage Prediction Intervals with Gaussian Process Regression
• Concepts and Applications of Conformal Prediction in Computational Drug Discovery
• Reliable Probabilistic Classification with Neural Networks
• Multi-level conformal clustering: A distribution-free technique for clustering and anomaly detection
• Soft (Gaussian CDE) regression models and loss functions
• Assurance Monitoring of Learning Enabled Cyber-Physical Systems Using Inductive Conformal Prediction based on Distance Learning
• Assurance Monitoring of Cyber-Physical Systems with Machine Learning Components
• A novel Deep Learning approach for one-step Conformal Prediction approximation
• Exact Optimization of Conformal Predictors via Incremental and Decremental Learning
• Conformal Rule-Based Multi-label Classification
• ML-AQP: Query-Driven Approximate Query Processing based on Machine Learning
• Inject Machine Learning into Significance Test for Misspecified Linear Models
• Reliable Probability Intervals For Classification Using Inductive Venn Predictors Based on Distance Learning