MP-GELU Bayesian Neural Networks: Moment Propagation by GELU Nonlinearity

Yuki Hirayama, Sinya Takamaeda-Yamazaki

Bayesian neural networks (BNNs) have been an important framework in the study of uncertainty quantification. Deterministic variational inference, one of the inference methods, util…