45 citations · 144 across the 6 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.LG2020★ 4 cited
Exemplar Guided Active Learning
Jason Hartford, Kevin Leyton-Brown, Hadas Raviv +3
We consider the problem of wisely using a limited budget to label a small subset of a large unlabeled dataset. We are motivated by the NLP problem of word sense disambiguation. For…
cs.LG2020★ 14 cited
PMI-Masking: Principled masking of correlated spans
Yoav Levine, Barak Lenz, Opher Lieber +4
Masking tokens uniformly at random constitutes a common flaw in the pretraining of Masked Language Models (MLMs) such as BERT. We show that such uniform masking allows an MLM to mi…