1 paper
Yonatan Bitton, Gabriel Stanovsky, Michael Elhadad +1
Masked language modeling (MLM) is one of the key sub-tasks in vision-language pretraining. In the cross-modal setting, tokens in the sentence are masked at random, and the model pr…