Sentence Representation Learning with Generative Objective rather than Contrastive Objective

Bohong Wu, Hai Zhao

Though offering amazing contextualized token-level representations, current pre-trained language models take less attention on accurately acquiring sentence-level representation du…