Limitations of Autoregressive Models and Their Alternatives

Chu-Cheng Lin, Aaron Jaech, Xin Li +2

Standard autoregressive language models perform only polynomial-time computation to compute the probability of the next symbol. While this is attractive, it means they cannot model…