Learning Bounded Context-Free-Grammar via LSTM and the Transformer:Difference and Explanations

Hui Shi, Sicun Gao, Yuandong Tian +2

Long Short-Term Memory (LSTM) and Transformers are two popular neural architectures used for natural language processing tasks. Theoretical results show that both are Turing-comple…