Dirichlet-based Gaussian Processes for Large-scale Calibrated Classification

Abstract

In this paper, we study the problem of deriving fast and accurate classification algorithms with uncertainty quantification. Gaussian process classification provides a principled approach, but the corresponding computational burden is hardly sustainable in large-scale problems and devising efficient alternatives is a challenge. In this work, we investigate if and how Gaussian process regression directly applied to the classification labels can be used to tackle this question. While in this case training time is remarkably faster, predictions need be calibrated for classification and uncertainty estimation. To this aim, we propose a novel approach based on interpreting the labels as the output of a Dirichlet distribution. Extensive experimental results show that the proposed approach provides essentially the same accuracy and uncertainty quantification of Gaussian process classification while requiring only a fraction of computational resources.

Cited by in corpus (10)

• Classifier Calibration: A survey on how to assess and improve predicted class probabilities
• When Gaussian Process Meets Big Data: A Review of Scalable GPs
• Calibration of Deep Probabilistic Models with Decoupled Bayesian Neural Networks
• Multi-Class Uncertainty Calibration via Mutual Information Maximization-based Binning
• Distribution-free binary classification: prediction sets, confidence intervals and calibration
• Kernel Interpolation for Scalable Online Gaussian Processes
• Scalable Gaussian Process Classification with Additive Noise for Various Likelihoods
• Recursive Bayesian Networks: Generalising and Unifying Probabilistic Context-Free Grammars and Dynamic Bayesian Networks
• Deep Classifiers with Label Noise Modeling and Distance Awareness
• Complex-to-Real Sketches for Tensor Products with Applications to the Polynomial Kernel