Bayesian Active Learning by Disagreements: A Geometric Perspective

Abstract

We present geometric Bayesian active learning by disagreements (GBALD), a framework that performs BALD on its core-set construction interacting with model uncertainty estimation. Technically, GBALD constructs core-set on ellipsoid, not typical sphere, preventing low-representative elements from spherical boundaries. The improvements are twofold: 1) relieve uninformative prior and 2) reduce redundant estimations. Theoretically, geodesic search with ellipsoid can derive tighter lower bound on error and easier to achieve zero error than with sphere. Experiments show that GBALD has slight perturbations to noisy and repeated samples, and outperforms BALD, BatchBALD and other existing deep active learning approaches.

References in corpus (8)

• Bayesian Active Learning for Classification and Preference Learning
• BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learning
• Near-Optimal Bayesian Active Learning with Noisy Observations
• Automated Scalable Bayesian Inference via Hilbert Coresets
• Active Learning for Cost-Sensitive Classification
• Learning search spaces for Bayesian optimization: Another view of hyperparameter transfer learning
• Bayesian Generative Active Deep Learning
• Deep Bayesian Active Learning for Multiple Correct Outputs