Multivariate Uncertainty Quantification with Tomographic Quantile Forests

Abstract

Quantifying predictive uncertainty is essential for safe and trustworthy real-world AI deployment. Yet, fully nonparametric estimation of conditional distributions remains challenging for multivariate targets. We propose Tomographic Quantile Forests (TQF), a nonparametric, uncertainty-aware, tree-based regression model for multivariate targets. TQF learns conditional quantiles of directional projections ${\mathbf{n}}^{\top }\mathbf{y}$ as functions of the input $\mathbf{x}$ and the unit direction $\mathbf{n}$. At inference, it aggregates quantiles across many directions and reconstructs the multivariate conditional distribution by minimizing the sliced Wasserstein distance via an efficient alternating scheme with convex subproblems. Unlike classical directional-quantile approaches that typically produce only convex quantile regions and require training separate models for different directions, TQF covers all directions with a single model without imposing convexity restrictions. We evaluate TQF on synthetic and real-world datasets, and release the source code on GitHub.

36 pages. v2: matches published version

References in corpus (25)

• XGBoost: A Scalable Tree Boosting System
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Rejoinder to "Least angle regression" by Efron et al
• Least Angle Regression
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods
• Multivariate quantiles and multiple-output regression quantiles: From $L_1$ optimization to halfspace depth
• Conformal Prediction: a Unified Review of Theory and New Challenges
• A review of predictive uncertainty estimation with machine learning
• Multi-Target Regression via Random Linear Target Combinations
• Deeply Uncertain: Comparing Methods of Uncertainty Quantification in Deep Learning Algorithms
• Distributional Regression Forests for Probabilistic Precipitation Forecasting in Complex Terrain
• How to Evaluate Uncertainty Estimates in Machine Learning for Regression?
• Probabilistic approach to limited-data computed tomography reconstruction
• Proper Scoring Rules for Multivariate Probabilistic Forecasts based on Aggregation and Transformation
• Sample-based Uncertainty Quantification with a Single Deterministic Neural Network
• Mixability of Integral Losses: a Key to Efficient Online Aggregation of Functional and Probabilistic Forecasts