A Deep Look into Neural Ranking Models for Information Retrieval

Abstract

Ranking models lie at the heart of research on information retrieval (IR). During the past decades, different techniques have been proposed for constructing ranking models, from traditional heuristic methods, probabilistic methods, to modern machine learning methods. Recently, with the advance of deep learning technology, we have witnessed a growing body of work in applying shallow or deep neural networks to the ranking problem in IR, referred to as neural ranking models in this paper. The power of neural ranking models lies in the ability to learn from the raw text inputs for the ranking problem to avoid many limitations of hand-crafted features. Neural networks have sufficient capacity to model complicated tasks, which is needed to handle the complexity of relevance estimation in ranking. Since there have been a large variety of neural ranking models proposed, we believe it is the right time to summarize the current status, learn from existing methodologies, and gain some insights for future development. In contrast to existing reviews, in this survey, we will take a deep look into the neural ranking models from different dimensions to analyze their underlying assumptions, major design principles, and learning strategies. We compare these models through benchmark tasks to obtain a comprehensive empirical understanding of the existing techniques. We will also discuss what is missing in the current literature and what are the promising and desired future directions.

References in corpus (28)

• Distributed Representations of Words and Phrases and their Compositionality
• Convolutional Neural Network Architectures for Matching Natural Language Sentences
• A Deep Relevance Matching Model for Ad-hoc Retrieval
• SQuAD: 100,000+ Questions for Machine Comprehension of Text
• End-to-End Neural Ad-hoc Ranking with Kernel Pooling
• Deep Learning for Answer Sentence Selection
• A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representations
• An Information Retrieval Approach to Short Text Conversation
• Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems
• Simple Applications of BERT for Ad Hoc Document Retrieval
• Word-Entity Duet Representations for Document Ranking
• Modeling Diverse Relevance Patterns in Ad-hoc Retrieval
• Analyzing and Characterizing User Intent in Information-seeking Conversations
• Neural Vector Spaces for Unsupervised Information Retrieval
• Neural Models for Information Retrieval
• A Study of MatchPyramid Models on Ad-hoc Retrieval
• Applying Deep Learning to Answer Selection: A Study and An Open Task
• A Compare-Aggregate Model for Matching Text Sequences
• MatchZoo: A Toolkit for Deep Text Matching
• ViTOR: Learning to Rank Webpages Based on Visual Features
• Knowledge Enhanced Hybrid Neural Network for Text Matching
• Avoiding Your Teacher's Mistakes: Training Neural Networks with Controlled Weak Supervision
• Neural Matching Models for Question Retrieval and Next Question Prediction in Conversation
• ComQA: A Community-sourced Dataset for Complex Factoid Question Answering with Paraphrase Clusters
• DeepTileBars: Visualizing Term Distribution for Neural Information Retrieval
• Adaptability of Neural Networks on Varying Granularity IR Tasks
• Learning Visual Features from Snapshots for Web Search
• End-to-End Neural Ranking for eCommerce Product Search: an application of task models and textual embeddings

Cited by in corpus (9)

• ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
• Simple Applications of BERT for Ad Hoc Document Retrieval
• Beyond 512 Tokens: Siamese Multi-depth Transformer-based Hierarchical Encoder for Long-Form Document Matching
• A Hybrid Retrieval-Generation Neural Conversation Model
• Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering
• Self-Attentive Document Interaction Networks for Permutation Equivariant Ranking
• IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems
• Long Document Ranking with Query-Directed Sparse Transformer
• Using the Hammer Only on Nails: A Hybrid Method for Evidence Retrieval for Question Answering