Metric Entropy Limits on Recurrent Neural Network Learning of Linear Dynamical Systems

Clemens Hutter, Recep Gül, Helmut Bölcskei

One of the most influential results in neural network theory is the universal approximation theorem [1, 2, 3] which states that continuous functions can be approximated to within a…