Stochastic Neural Networks with Monotonic Activation Functions

Siamak Ravanbakhsh, Barnabas Poczos, Jeff Schneider +2

We propose a Laplace approximation that creates a stochastic unit from any smooth monotonic activation function, using only Gaussian noise. This paper investigates the application…