Linear representations of grammaticality in neural language models

Jane Li, Najoung Kim

Whether neural language models (NLMs) possess the ability to distinguish strings on the basis of their grammaticality remains a debated topic in the computational linguistics liter…