Deep Probabilistic Ensembles: Approximate Variational Inference through KL Regularization

Kashyap Chitta, Jose M. Alvarez, Adam Lesnikowski

In this paper, we introduce Deep Probabilistic Ensembles (DPEs), a scalable technique that uses a regularized ensemble to approximate a deep Bayesian Neural Network (BNN). We do so…