On the Robustness of Language Encoders against Grammatical Errors

Fan Yin, Quanyu Long, Tao Meng +1

We conduct a thorough study to diagnose the behaviors of pre-trained language encoders (ELMo, BERT, and RoBERTa) when confronted with natural grammatical errors. Specifically, we c…