Memory Capacity of Recurrent Neural Networks with Matrix Representation

Animesh Renanse, Alok Sharma, Rohitash Chandra

It is well known that canonical recurrent neural networks (RNNs) face limitations in learning long-term dependencies which have been addressed by memory structures in long short-te…