Pretraining De-Biased Language Model with Large-scale Click Logs for Document Ranking

Xiangsheng Li, Xiaoshu Chen, Kunliang Wei +4

Pre-trained language models have achieved great success in various large-scale information retrieval tasks. However, most of pretraining tasks are based on counterfeit retrieval da…