Adaptive Noise Injection: A Structure-Expanding Regularization for RNN

Rui Li, Kai Shuang, Mengyu Gu +1

The vanilla LSTM has become one of the most potential architectures in word-level language modeling, like other recurrent neural networks, overfitting is always a key barrier for i…