177 citations · 190 across the 7 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022★ 4 cited
When classifying grammatical role, BERT doesn't care about word order... except when it matters
Isabel Papadimitriou, Richard Futrell, Kyle Mahowald
Because meaning can often be inferred from lexical semantics alone, word order is often a redundant cue in natural language. For example, the words chopped, chef, and onion are mor…
cs.CL2022★ 6 cited
Oolong: Investigating What Makes Transfer Learning Hard with Controlled Studies
Zhengxuan Wu, Alex Tamkin, Isabel Papadimitriou
When we transfer a pretrained language model to a new language, there are many axes of variation that change at once. To disentangle the impact of different factors like syntactic…