Contextual Distortion Reveals Constituency: Masked Language Models are Implicit Parsers

Jiaxi Li, Wei Lu

Recent advancements in pre-trained language models (PLMs) have demonstrated that these models possess some degree of syntactic awareness. To leverage this knowledge, we propose a n…