Pre-training with Aspect-Content Text Mutual Prediction for Multi-Aspect Dense Retrieval

Xiaojie Sun, Keping Bi, Jiafeng Guo +5

Grounded on pre-trained language models (PLMs), dense retrieval has been studied extensively on plain text. In contrast, there has been little research on retrieving data with mult…