Variational Adaptive Noise and Dropout towards Stable Recurrent Neural Networks

Taisuke Kobayashi, Shingo Murata

This paper proposes a novel stable learning theory for recurrent neural networks (RNNs), so-called variational adaptive noise and dropout (VAND). As stabilizing factors for RNNs, n…