Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrieval

Weihang Su, Qingyao Ai, Xiangsheng Li +4

With the development of deep learning and natural language processing techniques, pre-trained language models have been widely used to solve information retrieval (IR) problems. Be…