Do RNNs learn human-like abstract word order preferences?

Richard Futrell, Roger P. Levy

RNN language models have achieved state-of-the-art results on various tasks, but what exactly they are representing about syntax is as yet unclear. Here we investigate whether RNN…