Highway State Gating for Recurrent Highway Networks: improving information flow through time

Ron Shoham, Haim Permuter

Recurrent Neural Networks (RNNs) play a major role in the field of sequential learning, and have outperformed traditional algorithms on many benchmarks. Training deep RNNs still re…