Showing cs.LGShow all
3 papers · 1 filter
cs.LG2018
Stochastic Normalizations as Bayesian Learning
Alexander Shekhovtsov, Boris Flach
In this work we investigate the reasons why Batch Normalization (BN) improves the generalization performance of deep networks. We argue that one major reason, distinguishing it fro…
cs.LG2018
Normalization of Neural Networks using Analytic Variance Propagation
Alexander Shekhovtsov, Boris Flach
We address the problem of estimating statistics of hidden units in a neural network using a method of analytic moment propagation. These statistics are useful for approximate white…
cs.LG2017
Generative learning for deep networks
Boris Flach, Alexander Shekhovtsov, Ondrej Fikar
Learning, taking into account full distribution of the data, referred to as generative, is not feasible with deep neural networks (DNNs) because they model only the conditional dis…