1 citations · 2 across the 4 of their papers we have counts for
4 papers
Learning from Children: Improving Image-Caption Pretraining via Curriculum
Hammad A. Ayyubi, Rahul Lokesh, Alireza Zareian +2
Image-caption pretraining has been quite successfully used for downstream vision tasks like zero-shot image classification and object detection. However, image-caption pretraining…
Extrapolating Multilingual Understanding Models as Multilingual Generators
Bohong Wu, Fei Yuan, Hai Zhao +2
Multilingual understanding models (or encoder-based), pre-trained via masked language modeling, have achieved promising results on many language understanding tasks (e.g., mBERT).…
Sentence Representation Learning with Generative Objective rather than Contrastive Objective
Bohong Wu, Hai Zhao
Though offering amazing contextualized token-level representations, current pre-trained language models take less attention on accurately acquiring sentence-level representation du…
Generative or Contrastive? Phrase Reconstruction for Better Sentence Representation Learning
Bohong Wu, Hai Zhao
Though offering amazing contextualized token-level representations, current pre-trained language models actually take less attention on acquiring sentence-level representation duri…