Discovering alternative solutions beyond the simplicity bias in recurrent neural networks

William Qian, Cengiz Pehlevan

Training recurrent neural networks (RNNs) to perform neuroscience-style tasks has become a popular way to generate hypotheses for how neural circuits in the brain might perform com…