Learnability Window in Gated Recurrent Neural Networks

Lorenzo Livi

We develop a statistical theory of temporal learnability in recurrent neural networks, quantifying the maximal temporal horizon ${\mathcal{H}}_N$ over which gradient-based learning c…