Gradual Learning of Recurrent Neural Networks

Ziv Aharoni, Gal Rattner, Haim Permuter

Recurrent Neural Networks (RNNs) achieve state-of-the-art results in many sequence-to-sequence modeling tasks. However, RNNs are difficult to train and tend to suffer from overfitt…