Overestimation of Syntactic Representationin Neural Language Models

Jordan Kodner, Nitish Gupta

With the advent of powerful neural language models over the last few years, research attention has increasingly focused on what aspects of language they represent that make them so…