Can a Confident Prior Replace a Cold Posterior?

Martin Marek, Brooks Paige, Pavel Izmailov

Benchmark datasets used for image classification tend to have very low levels of label noise. When Bayesian neural networks are trained on these datasets, they often underfit, misr…