ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference

Kai Hui, Honglei Zhuang, Tao Chen +8

State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradig…