Showing 2018Show all
3 papers · 1 filter
cs.LG2018
Stochastic Normalizations as Bayesian Learning
Alexander Shekhovtsov, Boris Flach
In this work we investigate the reasons why Batch Normalization (BN) improves the generalization performance of deep networks. We argue that one major reason, distinguishing it fro…
cs.LG2018
Normalization of Neural Networks using Analytic Variance Propagation
Alexander Shekhovtsov, Boris Flach
We address the problem of estimating statistics of hidden units in a neural network using a method of analytic moment propagation. These statistics are useful for approximate white…
stat.ML2018
Feed-forward Uncertainty Propagation in Belief and Neural Networks
Alexander Shekhovtsov, Boris Flach, Michal Busta
We propose a feed-forward inference method applicable to belief and neural networks. In a belief network, the method estimates an approximate factorized posterior of all hidden uni…