On Uniform, Bayesian, and PAC-Bayesian Deep Ensembles

Nick Hauptvogel, Christian Igel

It is common practice to combine deep neural networks into ensembles. These deep ensembles can benefit from the cancellation of errors effect: Errors by ensemble members may averag…