2.7k citations · 2.7k across the 13 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022
Uniform Masking Prevails in Vision-Language Pretraining
Siddharth Verma, Yuchen Lu, Rui Hou +4
Masked Language Modeling (MLM) has proven to be an essential component of Vision-Language (VL) pretraining. To implement MLM, the researcher must make two design choices: the maski…
cs.CL2022★ 3 cited
IDPG: An Instance-Dependent Prompt Generation Method
Zhuofeng Wu, Sinong Wang, Jiatao Gu +4
Prompt tuning is a new, efficient NLP transfer learning paradigm that adds a task-specific prompt in each input instance during the model training stage. It freezes the pre-trained…