Efficient Neural Ranking using Forward Indexes and Lightweight Encoders

Jurek Leonhardt, Henrik Müller, Koustav Rudra +3

Dual-encoder-based dense retrieval models have become the standard in IR. They employ large Transformer-based language models, which are notoriously inefficient in terms of resourc…