A Deep Relevance Matching Model for Ad-hoc Retrieval

Abstract

In recent years, deep neural networks have led to exciting breakthroughs in speech recognition, computer vision, and natural language processing (NLP) tasks. However, there have been few positive results of deep models on ad-hoc retrieval tasks. This is partially due to the fact that many important characteristics of the ad-hoc retrieval task have not been well addressed in deep models yet. Typically, the ad-hoc retrieval task is formalized as a matching problem between two pieces of text in existing work using deep models, and treated equivalent to many NLP tasks such as paraphrase identification, question answering and automatic conversation. However, we argue that the ad-hoc retrieval task is mainly about relevance matching while most NLP matching tasks concern semantic matching, and there are some fundamental differences between these two matching tasks. Successful relevance matching requires proper handling of the exact matching signals, query term importance, and diverse matching requirements. In this paper, we propose a novel deep relevance matching model (DRMM) for ad-hoc retrieval. Specifically, our model employs a joint deep architecture at the query term level for relevance matching. By using matching histogram mapping, a feed forward matching network, and a term gating network, we can effectively deal with the three relevance matching factors mentioned above. Experimental results on two representative benchmark collections show that our model can significantly outperform some well-known retrieval models as well as state-of-the-art deep matching models.

CIKM 2016, long paper

References in corpus (3)

• Convolutional Neural Network Architectures for Matching Natural Language Sentences
• A Convolutional Neural Network for Modelling Sentences
• Syntax-based Deep Matching of Short Texts

Cited by in corpus (110)

• End-to-End Neural Ad-hoc Ranking with Kernel Pooling
• Deeper Text Understanding for IR with Contextual Neural Language Modeling
• Multi-Stage Document Ranking with BERT
• Long Range Arena: A Benchmark for Efficient Transformers
• Understanding the Behaviors of BERT in Ranking
• Simple Applications of BERT for Ad Hoc Document Retrieval
• Word-Entity Duet Representations for Document Ranking
• Representation Learning for Natural Language Processing
• GERE: Generative Evidence Retrieval for Fact Verification
• A study on the Interpretability of Neural Retrieval Models using DeepSHAP
• Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval
• Unseen Class Discovery in Open-world Classification
• CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks
• MatchZoo: A Learning, Practicing, and Developing System for Neural Text Matching
• Neural Information Retrieval: A Literature Review
• The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models
• Multiresolution Graph Attention Networks for Relevance Matching
• MatchZoo: A Toolkit for Deep Text Matching
• A Study of Neural Matching Models for Cross-lingual IR
• StruBERT: Structure-aware BERT for Table Search and Matching
• Learning a Product Relevance Model from Click-Through Data in E-Commerce
• Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillation
• Novel Entity Discovery from Web Tables
• Learning to Selectively Transfer: Reinforced Transfer Learning for Deep Text Matching
• Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval
• Neural Matching Models for Question Retrieval and Next Question Prediction in Conversation
• Helping results assessment by adding explainable elements to the deep relevance matching model
• Towards Axiomatic Explanations for Neural Ranking Models
• Preliminary Exploration of Formula Embedding for Mathematical Information Retrieval: can mathematical formulae be embedded like a natural language?
• Cross-lingual Information Retrieval with BERT
• Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks
• Selective Weak Supervision for Neural Information Retrieval
• A Multi-task Learning Framework for Product Ranking with BERT
• Passage Ranking with Weak Supervision
• Leveraging Semantic and Lexical Matching to Improve the Recall of Document Retrieval Systems: A Hybrid Approach
• Graph-based Hierarchical Relevance Matching Signals for Ad-hoc Retrieval
• Match-Tensor: a Deep Relevance Model for Search
• A Deep Look into Neural Ranking Models for Information Retrieval
• Learning Contextualized Document Representations for Healthcare Answer Retrieval
• Semantic Product Search
• Learning to Match Using Local and Distributed Representations of Text for Web Search
• GRAPHENE: A Precise Biomedical Literature Retrieval Engine with Graph Augmented Deep Learning and External Knowledge Empowerment
• A Deep Investigation of Deep IR Models
• COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
• Query Focused Multi-Document Summarization with Distant Supervision
• Legal Element-oriented Modeling with Multi-view Contrastive Learning for Legal Case Retrieval
• Domain Adaptation for Enterprise Email Search
• Neural IR Meets Graph Embedding: A Ranking Model for Product Search
• Co-PACRR: A Context-Aware Neural IR Model for Ad-hoc Retrieval
• Improving Low-Resource Cross-lingual Document Retrieval by Reranking with Deep Bilingual Representations
• Guided Transformer: Leveraging Multiple External Sources for Representation Learning in Conversational Search
• One word at a time: adversarial attacks on retrieval models
• Variational Deep Semantic Hashing for Text Documents
• Integrating Lexical and Temporal Signals in Neural Ranking Models for Searching Social Media Streams
• Longformer for MS MARCO Document Re-ranking Task
• A Modern Perspective on Query Likelihood with Deep Generative Retrieval Models
• A Comparison of Supervised Learning to Match Methods for Product Search
• Modeling Document Interactions for Learning to Rank with Regularized Self-Attention
• Towards Personalized and Semantic Retrieval: An End-to-End Solution for E-commerce Search via Embedding Learning
• Neural Ranking Models with Weak Supervision
• LATTE: Latent Type Modeling for Biomedical Entity Linking
• SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrieval
• Pre-trained Language Model for Web-scale Retrieval in Baidu Search
• Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots
• ICS-Assist: Intelligent Customer Inquiry Resolution Recommendation in Online Customer Service for Large E-Commerce Businesses
• BanditRank: Learning to Rank Using Contextual Bandits
• Heterogeneous Network Embedding for Deep Semantic Relevance Match in E-commerce Search
• IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems
• Getting Started with Neural Models for Semantic Matching in Web Search
• Keyword Extraction for Improved Document Retrieval in Conversational Search
• Leveraging Advantages of Interactive and Non-Interactive Models for Vector-Based Cross-Lingual Information Retrieval
• Context Attentive Document Ranking and Query Suggestion
• MRNN: A Multi-Resolution Neural Network with Duplex Attention for Document Retrieval in the Context of Question Answering
• Impact of Training Dataset Size on Neural Answer Selection Models
• Curriculum Learning Strategies for IR: An Empirical Study on Conversation Response Ranking
• Biomedical Evidence Generation Engine
• Separate and Attend in Personal Email Search
• Patient Cohort Retrieval using Transformer Language Models
• Toward the Understanding of Deep Text Matching Models for Information Retrieval
• Modeling Relevance Ranking under the Pre-training and Fine-tuning Paradigm
• Self-supervised Answer Retrieval on Clinical Notes
• Neural Ranking Models with Multiple Document Fields
• GazBy: Gaze-Based BERT Model to Incorporate Human Attention in Neural Information Retrieval
• Luandri: a Clean Lua Interface to the Indri Search Engine
• Fine-tune BERT for E-commerce Non-Default Search Ranking
• Embedding-based Product Retrieval in Taobao Search
• Optimize What You Evaluate With: A Simple Yet Effective Framework For Direct Optimization Of IR Metrics
• DeText: A Deep Text Ranking Framework with BERT
• Pre-training for Ad-hoc Retrieval: Hyperlink is Also You Need
• Pre-trained Language Model based Ranking in Baidu Search
• Cross-language Citation Recommendation via Hierarchical Representation Learning on Heterogeneous Graph
• Learning Fast Matching Models from Weak Annotations
• Neural Search: Learning Query and Product Representations in Fashion E-commerce
• More Robust Dense Retrieval with Contrastive Dual Learning
• Practical User Feedback-driven Internal Search Using Online Learning to Rank
• PT-Ranking: A Benchmarking Platform for Neural Learning-to-Rank
• Exploiting Sentence-Level Representations for Passage Ranking
• Gender Stereotype Reinforcement: Measuring the Gender Bias Conveyed by Ranking Algorithms
• LRG at TREC 2020: Document Ranking with XLNet-Based Models
• BERT Embeddings Can Track Context in Conversational Search
• Fake News Data Collection and Classification: Iterative Query Selection for Opaque Search Engines with Pseudo Relevance Feedback
• A unified Neural Network Approach to E-CommerceRelevance Learning
• Cross-Modality Relevance for Reasoning on Language and Vision
• AutoSUM: Automating Feature Extraction and Multi-user Preference Simulation for Entity Summarization
• Embracing Structure in Data for Billion-Scale Semantic Product Search
• MIRA: Leveraging Multi-Intention Co-click Information in Web-scale Document Retrieval using Deep Neural Networks
• YES SIR!Optimizing Semantic Space of Negatives with Self-Involvement Ranker
• Deep Natural Language Processing for LinkedIn Search
• Place Deduplication with Embeddings
• TPRM: A Topic-based Personalized Ranking Model for Web Search