Reducing state updates via Gaussian-gated LSTMs

Matthew Thornton, Jithendar Anumula, Shih-Chii Liu

Recurrent neural networks can be difficult to train on long sequence data due to the well-known vanishing gradient problem. Some architectures incorporate methods to reduce RNN sta…