Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Training

Yibin Lei, Liang Ding, Yu Cao +3

Dense retrievers have achieved impressive performance, but their demand for abundant training data limits their application scenarios. Contrastive pre-training, which constructs ps…