Stochastic Bayesian Neural Networks

Abstract

Bayesian neural networks perform variational inference over the weights however calculation of the posterior distribution remains a challenge. Our work builds on variational inference techniques for bayesian neural networks using the original Evidence Lower Bound. In this paper, we present a stochastic bayesian neural network in which we maximize Evidence Lower Bound using a new objective function which we name as Stochastic Evidence Lower Bound. We evaluate our network on 5 publicly available UCI datasets using test RMSE and log likelihood as the evaluation metrics. We demonstrate that our work not only beats the previous state of the art algorithms but is also scalable to larger datasets.

There is an error in modelling stochastic process. Hence the results are not correct

References in corpus (13)

• Weight Uncertainty in Neural Networks
• Deep Bayesian Active Learning with Image Data
• Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networks
• Towards Principled Methods for Training Generative Adversarial Networks
• A Simple Baseline for Bayesian Uncertainty in Deep Learning
• Functional Variational Bayesian Neural Networks
• Variational Inference using Implicit Distributions
• Sticking the Landing: Simple, Lower-Variance Gradient Estimators for Variational Inference
• Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam
• Structured Variational Learning of Bayesian Neural Networks with Horseshoe Priors
• On the Importance of Strong Baselines in Bayesian Deep Learning
• Noisy Natural Gradient as Variational Inference
• Kernel Implicit Variational Inference