12 citations · 18 across the 9 of their papers we have counts for
1 paper · 1 filter
Nafis Sadeq, Canwen Xu, Julian McAuley
Masked language modeling is widely used for pretraining large language models for natural language understanding (NLU). However, random masking is suboptimal, allocating an equal m…