The difference between memory and prediction in linear recurrent networks

Sarah Marzen

Recurrent networks are trained to memorize their input better, often in the hopes that such training will increase the ability of the network to predict. We show that networks desi…