565 citations · 766 across the 31 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.CL2019
BLiMP: The Benchmark of Linguistic Minimal Pairs for English
Alex Warstadt, Alicia Parrish, Haokun Liu +4
We introduce The Benchmark of Linguistic Minimal Pairs (shortened to BLiMP), a challenge set for evaluating what language models (LMs) know about major grammatical phenomena in Eng…
cs.CL2019★ 2 cited
Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs
Alex Warstadt, Yu Cao, Ioana Grosu +13
Though state-of-the-art sentence representation models can perform tasks requiring significant knowledge of grammar, it is an open question how best to evaluate their grammatical k…
cs.CL2019★ 19 cited
Linguistic Analysis of Pretrained Sentence Encoders with Acceptability Judgments
Alex Warstadt, Samuel R. Bowman
Recent work on evaluating grammatical knowledge in pretrained sentence encoders gives a fine-grained view of a small number of phenomena. We introduce a new analysis dataset that a…