When does word order matter and when doesn't it?

Xuanda Chen, Timothy O'Donnell, Siva Reddy

Language models (LMs) may appear insensitive to word order changes in natural language understanding (NLU) tasks. In this paper, we propose that linguistic redundancy can explain t…