Gaussian Mean Field Variational Inference can Overestimate Predictive Variance

James Odgers, Ben Riegler, Siddharth Swaroop +1

Mean Field Variational Inference (MFVI) is widely understood to underestimate posterior variance. By analysing conjugate Bayesian Linear Regression (BLR), we show that this charact…