Variational Inference of overparameterized Bayesian Neural Networks: a theoretical and empirical study

Tom Huix, Szymon Majewski, Alain Durmus +2

This paper studies the Variational Inference (VI) used for training Bayesian Neural Networks (BNN) in the overparameterized regime, i.e., when the number of neurons tends to infini…