6 citations · 7 across the 10 of their papers we have counts for
1 paper · 1 filter
Gokul Srinivasagan, Kai Hartung, Munir Georges
Masked language modeling has become a standard pretraining objective for training encoder-based language models. In this approach, certain tokens in the input are masked, and the m…