Towards Robust Classification with Deep Generative Forests

Abstract

Decision Trees and Random Forests are among the most widely used machine learning models, and often achieve state-of-the-art performance in tabular, domain-agnostic datasets. Nonetheless, being primarily discriminative models they lack principled methods to manipulate the uncertainty of predictions. In this paper, we exploit Generative Forests (GeFs), a recent class of deep probabilistic models that addresses these issues by extending Random Forests to generative models representing the full joint distribution over the feature space. We demonstrate that GeFs are uncertainty-aware classifiers, capable of measuring the robustness of each prediction as well as detecting out-of-distribution samples.

arXiv commentPresented at the ICML 2020 Workshop on Uncertainty and Robustness in Deep Learning

References in corpus (8)

• Auto-Encoding Variational Bayes
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Variational Inference with Normalizing Flows
• OpenML: networked science in machine learning
• Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks
• Quantifying Uncertainty in Random Forests via Confidence Intervals and Hypothesis Tests
• Adversarial Examples, Uncertainty, and Transfer Testing Robustness in Gaussian Process Hybrid Deep Networks
• Joints in Random Forests