Echoes of the Past: A Unified Perspective on Fading memory and Echo States

Juan-Pablo Ortega, Florian Rossmannek

Recurrent neural networks (RNNs) have become increasingly popular in information processing tasks involving time series and temporal data. A fundamental property of RNNs is their a…