A Deep Look into Neural Ranking Models for Information Retrieval

Abstract

Ranking models lie at the heart of research on information retrieval (IR). During the past decades, different techniques have been proposed for constructing ranking models, from traditional heuristic methods, probabilistic methods, to modern machine learning methods. Recently, with the advance of deep learning technology, we have witnessed a growing body of work in applying shallow or deep neural networks to the ranking problem in IR, referred to as neural ranking models in this paper. The power of neural ranking models lies in the ability to learn from the raw text inputs for the ranking problem to avoid many limitations of hand-crafted features. Neural networks have sufficient capacity to model complicated tasks, which is needed to handle the complexity of relevance estimation in ranking. Since there have been a large variety of neural ranking models proposed, we believe it is the right time to summarize the current status, learn from existing methodologies, and gain some insights for future development. In contrast to existing reviews, in this survey, we will take a deep look into the neural ranking models from different dimensions to analyze their underlying assumptions, major design principles, and learning strategies. We compare these models through benchmark tasks to obtain a comprehensive empirical understanding of the existing techniques. We will also discuss what is missing in the current literature and what are the promising and desired future directions.

References in corpus (15)

• Convolutional Neural Network Architectures for Matching Natural Language Sentences
• A Deep Relevance Matching Model for Ad-hoc Retrieval
• End-to-End Neural Ad-hoc Ranking with Kernel Pooling
• Deep Learning for Answer Sentence Selection
• An Information Retrieval Approach to Short Text Conversation
• Simple Applications of BERT for Ad Hoc Document Retrieval
• Word-Entity Duet Representations for Document Ranking
• A Compare-Aggregate Model for Matching Text Sequences
• MatchZoo: A Toolkit for Deep Text Matching
• ViTOR: Learning to Rank Webpages Based on Visual Features
• Avoiding Your Teacher's Mistakes: Training Neural Networks with Controlled Weak Supervision
• Knowledge Enhanced Hybrid Neural Network for Text Matching
• Neural Matching Models for Question Retrieval and Next Question Prediction in Conversation
• Adaptability of Neural Networks on Varying Granularity IR Tasks
• Learning Visual Features from Snapshots for Web Search

Cited by in corpus (4)

• Simple Applications of BERT for Ad Hoc Document Retrieval
• Self-Attentive Document Interaction Networks for Permutation Equivariant Ranking
• IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems
• Using the Hammer Only on Nails: A Hybrid Method for Evidence Retrieval for Question Answering