Counting in Language with RNNs

Heng xin Fun, Sergiy V Bokhnyak, Francesco Saverio Zuppichini

In this paper we examine a possible reason for the LSTM outperforming the GRU on language modeling and more specifically machine translation. We hypothesize that this has to do wit…