A Multi-level Distillation based Dense Passage Retrieval Model

Haifeng Li, Mo Hai, Dong Tang

Ranker and retriever are two important components in dense passage retrieval. The retriever typically adopts a dual-encoder model, where queries and documents are separately input…