Depth Enables Long-Term Memory for Recurrent Neural Networks

Alon Ziv

A key attribute that drives the unprecedented success of modern Recurrent Neural Networks (RNNs) on learning tasks which involve sequential data, is their ability to model intricat…