Modeling Diverse Relevance Patterns in Ad-hoc Retrieval
arXiv:1805.05737 · doi:10.1145/3209978.3209980
Abstract
Assessing relevance between a query and a document is challenging in ad-hoc retrieval due to its diverse patterns, i.e., a document could be relevant to a query as a whole or partially as long as it provides sufficient information for users' need. Such diverse relevance patterns require an ideal retrieval model to be able to assess relevance in the right granularity adaptively. Unfortunately, most existing retrieval models compute relevance at a single granularity, either document-wide or passage-level, or use fixed combination strategy, restricting their ability in capturing diverse relevance patterns. In this work, we propose a data-driven method to allow relevance signals at different granularities to compete with each other for final relevance assessment. Specifically, we propose a HIerarchical Neural maTching model (HiNT) which consists of two stacked components, namely local matching layer and global decision layer. The local matching layer focuses on producing a set of local relevance signals by modeling the semantic matching between a query and each passage of a document. The global decision layer accumulates local signals into different granularities and allows them to compete with each other to decide the final relevance score. Experimental results demonstrate that our HiNT model outperforms existing state-of-the-art retrieval models significantly on benchmark ad-hoc retrieval datasets.
arXiv commentThe 41st International ACM SIGIR Conference on Research \& Development in Information Retrieval, SIGIR'18
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- Distributed Representations of Words and Phrases and their Compositionality
- Convolutional Neural Network Architectures for Matching Natural Language Sentences
- A Deep Relevance Matching Model for Ad-hoc Retrieval
- DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval
- Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNN
- Neural Models for Information Retrieval
- A Study of MatchPyramid Models on Ad-hoc Retrieval
Cited by in corpus (18)
- Information Retrieval: Recent Advances and Beyond
- Pretrained Transformers for Text Ranking: BERT and Beyond
- Neural ranking models for document retrieval
- Match-Ignition: Plugging PageRank into Transformer for Long-form Text Matching
- B-PROP: Bootstrapped Pre-training with Representative Words Prediction for Ad-hoc Retrieval
- The Power of Selecting Key Blocks with Local Pre-ranking for Long Document Information Retrieval
- DeepTileBars: Visualizing Term Distribution for Neural Information Retrieval
- A Deep Look into Neural Ranking Models for Information Retrieval
- Learning To Rank Resources with GNN
- NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval
- A Modern Perspective on Query Likelihood with Deep Generative Retrieval Models
- Corpus-Level End-to-End Exploration for Interactive Systems
- GazBy: Gaze-Based BERT Model to Incorporate Human Attention in Neural Information Retrieval
- An In-depth Analysis of Passage-Level Label Transfer for Contextual Document Ranking
- WIKIR: A Python toolkit for building a large-scale Wikipedia-based English Information Retrieval Dataset
- A Domain Generalization Perspective on Listwise Context Modeling
- Cross-language Sentence Selection via Data Augmentation and Rationale Training
- Searching Personal Collections