Conformal inference for random objects
arXiv:2405.00294 · doi:10.1214/25-AOS2495
Abstract
We develop an inferential toolkit for analyzing object-valued responses, which correspond to data situated in general metric spaces, paired with Euclidean predictors within the conformal framework. To this end we introduce conditional profile average transport costs, where we compare distance profiles that correspond to one-dimensional distributions of probability mass falling into balls of increasing radius through the optimal transport cost when moving from one distance profile to another. The average transport cost to transport a given distance profile to all others is crucial for statistical inference in metric spaces and underpins the proposed conditional profile scores. A key feature of the proposed approach is to utilize the distribution of conditional profile average transport costs as conformity score for general metric space-valued responses, which facilitates the construction of prediction sets by the split conformal algorithm. We derive the uniform convergence rate of the proposed conformity score estimators and establish asymptotic conditional validity for the prediction sets. The finite sample performance for synthetic data in various metric spaces demonstrates that the proposed conditional profile score outperforms existing methods in terms of both coverage level and size of the resulting prediction sets, even in the special case of scalar Euclidean responses. We also demonstrate the practical utility of conditional profile scores for network data from New York taxi trips and for compositional data reflecting energy sourcing of U.S. states.
References in corpus (19)
- High-dimensional variable selection
- Functional data analysis for density functions by transformation to a Hilbert space
- Single and multiple index functional regression models with nonparametric link
- Functional single index models for longitudinal data
- Testing for Outliers with Conformal p-values
- Dimension reduction based on constrained canonical correlation and variable filtering
- A comparison of some conformal quantile regression methods
- On-line predictive linear regression
- Conformalized Quantile Regression
- On-line predictive linear regression
- Adaptive Conformal Inference Under Distribution Shift
- Conformal PID Control for Time Series Prediction
- Conformal Inference for Online Prediction with Arbitrary Distribution Shifts
- Nonparametric Statistical Inference via Metric Distribution Function in Metric Spaces
- Retrain or not retrain: Conformal test martingales for change-point detection
- A Two-Sample Conditional Distribution Test Using Conformal Prediction and Weighted Rank Sum
- CD-split and HPD-split: efficient conformal regions in high dimensions
- Conformal testing in a binary model situation
- Bellman Conformal Inference: Calibrating Prediction Intervals For Time Series