A ghost mechanism: An analytical model of abrupt learning in recurrent networks

Fatih Dinc, Ege Cirakman, Bariscan Kurtkaya +4

Abrupt learning is a common phenomenon in recurrent neural networks (RNNs) trained on working memory tasks. In such cases, the networks develop transient slow regions in state spac…