Does BERT agree? Evaluating knowledge of structure dependence through agreement relations

Geoff Bacon, Terry Regier

Learning representations that accurately model semantics is an important goal of natural language processing research. Many semantic phenomena depend on syntactic structure. Recent…