activity
20222026
most citedExploring the Long-Term Generalization of Counting Behavior in RNNs

2 citations · 2 across the 4 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.LG2023

Theoretical Conditions and Empirical Failure of Bracket Counting on Long Sequences with Linear Recurrent Networks

Nadine El-Naggar, Pranava Madhyastha, Tillman Weyde

Previous work has established that RNNs with an unbounded activation function have the capacity to count exactly. However, it has also been shown that RNNs are challenging to train…