State space models can express n-gram languages

Vinoth Nandakumar, Qiang Qu, Peng Mi +1

Recent advancements in recurrent neural networks (RNNs) have reinvigorated interest in their application to natural language processing tasks, particularly with the development of…