75 citations · 253 across the 38 of their papers we have counts for
Showing 2022 · cs.CLShow all
3 papers · 2 filters
cs.CL2022★ 1 cited
RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models
Shitao Xiao, Zheng Liu
To better support retrieval applications such as web search and question answering, growing effort is made to develop retrieval-oriented language models. Most of the existing works…
cs.CL2022★ 7 cited
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder
Shitao Xiao, Zheng Liu, Yingxia Shao +1
Despite pre-training's progress in many important NLP tasks, it remains to explore effective pre-training strategies for dense retrieval. In this paper, we propose RetroMAE, a new…
cs.CL2022★ 2 cited
A Mutually Reinforced Framework for Pretrained Sentence Embeddings
Junhan Yang, Zheng Liu, Shitao Xiao +5
The lack of labeled data is a major obstacle to learning high-quality sentence embeddings. Recently, self-supervised contrastive learning (SCL) is regarded as a promising way to ad…