most citedOn the Difference of BERT-style and CLIP-style Text Encoders

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CL2023★ 1 cited

On the Difference of BERT-style and CLIP-style Text Encoders

Zhihong Chen, Guiming Hardy Chen, Shizhe Diao +2

Masked language modeling (MLM) has been one of the most popular pretraining recipes in natural language processing, e.g., BERT, one of the representative models. Recently, contrast…