Efficient Neural Ranking using Forward Indexes
arXiv:2110.06051 · doi:10.1145/3485447.3511955
Abstract
Neural document ranking approaches, specifically transformer models, have achieved impressive gains in ranking performance. However, query processing using such over-parameterized models is both resource and time intensive. In this paper, we propose the Fast-Forward index -- a simple vector forward index that facilitates ranking documents using interpolation of lexical and semantic scores -- as a replacement for contextual re-rankers and dense indexes based on nearest neighbor search. Fast-Forward indexes rely on efficient sparse models for retrieval and merely look up pre-computed dense transformer-based vector representations of documents and passages in constant time for fast CPU-based semantic similarity computation during query processing. We propose index pruning and theoretically grounded early stopping techniques to improve the query processing throughput. We conduct extensive large-scale experiments on TREC-DL datasets and show improvements over hybrid indexes in performance and query processing efficiency using only CPUs. Fast-Forward indexes can provide superior ranking performance using interpolation due to the complementary benefits of lexical and semantic similarities.
arXiv commentFull paper at TheWebConf 2022
References in corpus (9)
- Deeper Text Understanding for IR with Contextual Neural Language Modeling
- CEDR: Contextualized Embeddings for Document Ranking
- A Dual Embedding Space Model for Document Ranking
- Expansion via Prediction of Importance with Contextualization
- PARADE: Passage Representation Aggregation for Document Reranking
- Boilerplate Removal using a Neural Sequence Labeling Model
- Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks
- Intra-Document Cascading: Learning to Select Passages for Neural Document Ranking
- Co-BERT: A Context-Aware BERT Retrieval Model Incorporating Local and Query-specific Context