Whiteout: Gaussian Adaptive Noise Regularization in Deep Neural Networks

Yinan Li, Fang Liu

Noise injection (NI) is an efficient technique to mitigate over-fitting in neural networks (NNs). The Bernoulli NI procedure as implemented in dropout and shakeout has connections…