Decoupling Hierarchical Recurrent Neural Networks With Locally Computable Losses

Asier Mujika, Felix Weissenberger, Angelika Steger

Learning long-term dependencies is a key long-standing challenge of recurrent neural networks (RNNs). Hierarchical recurrent neural networks (HRNNs) have been considered a promisin…