Singular Bayesian Neural Networks

Mame Diarra Toure, David A. Stephens

Bayesian neural networks promise calibrated uncertainty but require $O(mn)$ parameters for standard mean-field Gaussian posteriors. We argue this cost is often unnecessary, particu…