Improving Bi-encoder Document Ranking Models with Two Rankers and Multi-teacher Distillation

Jaekeol Choi, Euna Jung, Jangwon Suh +1

BERT-based Neural Ranking Models (NRMs) can be classified according to how the query and document are encoded through BERT's self-attention layers - bi-encoder versus cross-encoder…