A Deep Relevance Matching Model for Ad-hoc Retrieval
arXiv:1711.08611 · doi:10.1145/2983323.2983769
Abstract
In recent years, deep neural networks have led to exciting breakthroughs in speech recognition, computer vision, and natural language processing (NLP) tasks. However, there have been few positive results of deep models on ad-hoc retrieval tasks. This is partially due to the fact that many important characteristics of the ad-hoc retrieval task have not been well addressed in deep models yet. Typically, the ad-hoc retrieval task is formalized as a matching problem between two pieces of text in existing work using deep models, and treated equivalent to many NLP tasks such as paraphrase identification, question answering and automatic conversation. However, we argue that the ad-hoc retrieval task is mainly about relevance matching while most NLP matching tasks concern semantic matching, and there are some fundamental differences between these two matching tasks. Successful relevance matching requires proper handling of the exact matching signals, query term importance, and diverse matching requirements. In this paper, we propose a novel deep relevance matching model (DRMM) for ad-hoc retrieval. Specifically, our model employs a joint deep architecture at the query term level for relevance matching. By using matching histogram mapping, a feed forward matching network, and a term gating network, we can effectively deal with the three relevance matching factors mentioned above. Experimental results on two representative benchmark collections show that our model can significantly outperform some well-known retrieval models as well as state-of-the-art deep matching models.
arXiv commentCIKM 2016, long paper
References in corpus (5)
Cited by in corpus (215)
- XLNet: Generalized Autoregressive Pretraining for Language Understanding
- End-to-End Neural Ad-hoc Ranking with Kernel Pooling
- Deeper Text Understanding for IR with Contextual Neural Language Modeling
- Passage Re-ranking with BERT
- CEDR: Contextualized Embeddings for Document Ranking
- Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
- Multi-Stage Document Ranking with BERT
- DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval
- Long Range Arena: A Benchmark for Efficient Transformers
- Unbiased Learning to Rank with Unbiased Propensity Estimation
- ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
- Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems
- Understanding the Behaviors of BERT in Ranking
- Information Retrieval: Recent Advances and Beyond
- Learning a Deep Listwise Context Model for Ranking Refinement
- Simple Applications of BERT for Ad Hoc Document Retrieval
- Semantic Models for the First-stage Retrieval: A Comprehensive Review
- Biomedical Question Answering: A Survey of Approaches and Challenges
- Word-Entity Duet Representations for Document Ranking
- Modeling Diverse Relevance Patterns in Ad-hoc Retrieval
- Pretrained Transformers for Text Ranking: BERT and Beyond
- Rethinking Search: Making Domain Experts out of Dilettantes
- Beyond 512 Tokens: Siamese Multi-depth Transformer-based Hierarchical Encoder for Long-Form Document Matching
- Neural Vector Spaces for Unsupervised Information Retrieval
- Adversarial Sampling and Training for Semi-Supervised Information Retrieval
- Neural Models for Information Retrieval
- Critically Examining the "Neural Hype": Weak Baselines and the Additivity of Effectiveness Gains from Neural Ranking Models
- Sparse, Dense, and Attentional Representations for Text Retrieval
- Representation Learning for Natural Language Processing
- GERE: Generative Evidence Retrieval for Fact Verification
- Learning Groupwise Multivariate Scoring Functions Using Deep Neural Networks
- A study on the Interpretability of Neural Retrieval Models using DeepSHAP
- Complementing Lexical Retrieval with Semantic Residual Embedding
- Unseen Class Discovery in Open-world Classification
- Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval
- CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Tasks
- A Zero Attention Model for Personalized Product Search
- Bringing order into the realm of Transformer-based language models for artificial intelligence and law
- PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval
- Neural Information Retrieval: A Literature Review
- MatchZoo: A Learning, Practicing, and Developing System for Neural Text Matching
- Seq2Slate: Re-ranking and Slate Optimization with RNNs
- The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models
- Neural ranking models for document retrieval
- Multiresolution Graph Attention Networks for Relevance Matching
- MatchZoo: A Toolkit for Deep Text Matching
- A Study of Neural Matching Models for Cross-lingual IR
- Continual Learning for Generative Retrieval over Dynamic Corpora
- Adversarial Retriever-Ranker for dense text retrieval
- Generic Intent Representation in Web Search
- StruBERT: Structure-aware BERT for Table Search and Matching
- Content-Based Weak Supervision for Ad-Hoc Re-Ranking
- Learning a Product Relevance Model from Click-Through Data in E-Commerce
- Retrieve-and-Read: Multi-task Learning of Information Retrieval and Reading Comprehension
- A Quantum Many-body Wave Function Inspired Language Modeling Approach
- Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillation
- Lexically-Accelerated Dense Retrieval
- Combining Fact Extraction and Verification with Neural Semantic Matching Networks
- Novel Entity Discovery from Web Tables
- Learning to Selectively Transfer: Reinforced Transfer Learning for Deep Text Matching
- CoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Models
- Neural Matching Models for Question Retrieval and Next Question Prediction in Conversation
- Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval
- Towards Axiomatic Explanations for Neural Ranking Models
- Helping results assessment by adding explainable elements to the deep relevance matching model
- On-the-fly Table Generation
- DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling
- Preliminary Exploration of Formula Embedding for Mathematical Information Retrieval: can mathematical formulae be embedded like a natural language?
- A Hybrid Retrieval-Generation Neural Conversation Model
- Cross-lingual Information Retrieval with BERT
- Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey
- Recommending Themes for Ad Creative Design via Visual-Linguistic Representations
- Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks
- Selective Weak Supervision for Neural Information Retrieval
- Neural Passage Retrieval with Improved Negative Contrast
- Teaching a New Dog Old Tricks: Resurrecting Multilingual Retrieval Using Zero-shot Learning
- Match-Ignition: Plugging PageRank into Transformer for Long-form Text Matching
- A Multi-task Learning Framework for Product Ranking with BERT
- Passage Ranking with Weak Supervision
- B-PROP: Bootstrapped Pre-training with Representative Words Prediction for Ad-hoc Retrieval
- Deep Relevance Ranking Using Enhanced Document-Query Interactions
- Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning
- The Power of Selecting Key Blocks with Local Pre-ranking for Long Document Information Retrieval
- Graph-based Hierarchical Relevance Matching Signals for Ad-hoc Retrieval
- SetRank: Learning a Permutation-Invariant Ranking Model for Information Retrieval
- Leveraging Semantic and Lexical Matching to Improve the Recall of Document Retrieval Systems: A Hybrid Approach
- DeepTileBars: Visualizing Term Distribution for Neural Information Retrieval
- Match-Tensor: a Deep Relevance Model for Search
- SpaDE: Improving Sparse Representations using a Dual Document Encoder for First-stage Retrieval
- Generating Biomedical Question Answering Corpora from Q&A forums
- Target Apps Selection: Towards a Unified Search Framework for Mobile Devices
- Composite Re-Ranking for Efficient Document Search with BERT
- A Deep Look into Neural Ranking Models for Information Retrieval
- Learning Contextualized Document Representations for Healthcare Answer Retrieval
- Learning to Match Using Local and Distributed Representations of Text for Web Search
- Semantic Product Search
- A Deep Investigation of Deep IR Models
- GRAPHENE: A Precise Biomedical Literature Retrieval Engine with Graph Augmented Deep Learning and External Knowledge Empowerment
- Query Focused Multi-Document Summarization with Distant Supervision
- Embedding Electronic Health Records for Clinical Information Retrieval
- Legal Element-oriented Modeling with Multi-view Contrastive Learning for Legal Case Retrieval
- COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
- A Fast Deep Learning Model for Textual Relevance in Biomedical Information Retrieval
- Domain Adaptation for Enterprise Email Search
- Neural IR Meets Graph Embedding: A Ranking Model for Product Search
- Co-PACRR: A Context-Aware Neural IR Model for Ad-hoc Retrieval
- Improving Low-Resource Cross-lingual Document Retrieval by Reranking with Deep Bilingual Representations
- NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval
- Revealing the Importance of Semantic Retrieval for Machine Reading at Scale
- Guided Transformer: Leveraging Multiple External Sources for Representation Learning in Conversational Search
- Beyond Keywords and Relevance: A Personalized Ad Retrieval Framework in E-Commerce Sponsored Search
- Zero-shot Neural Passage Retrieval via Domain-targeted Synthetic Question Generation
- Are "Undocumented Workers" the Same as "Illegal Aliens"? Disentangling Denotation and Connotation in Vector Spaces
- Training a Ranking Function for Open-Domain Question Answering
- Variational Deep Semantic Hashing for Text Documents
- Deep Bag-of-Words Model: An Efficient and Interpretable Relevance Architecture for Chinese E-Commerce
- One word at a time: adversarial attacks on retrieval models
- Overcoming low-utility facets for complex answer retrieval
- Integrating Lexical and Temporal Signals in Neural Ranking Models for Searching Social Media Streams
- Longformer for MS MARCO Document Re-ranking Task
- MAWSEO: Adversarial Wiki Search Poisoning for Illicit Online Promotion
- A Modern Perspective on Query Likelihood with Deep Generative Retrieval Models
- CorDEL: A Contrastive Deep Learning Approach for Entity Linkage
- Interpreting search result rankings through intent modeling
- BERT-QE: Contextualized Query Expansion for Document Re-ranking
- Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinement
- SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrieval
- Pre-trained Language Model for Web-scale Retrieval in Baidu Search
- Multi-Perspective Relevance Matching with Hierarchical ConvNets for Social Media Search
- Neural Ranking Models with Weak Supervision
- Distributed Evaluations: Ending Neural Point Metrics
- Modeling Document Interactions for Learning to Rank with Regularized Self-Attention
- Towards Personalized and Semantic Retrieval: An End-to-End Solution for E-commerce Search via Embedding Learning
- A Comparison of Supervised Learning to Match Methods for Product Search
- A Zero Attentive Relevance Matching Networkfor Review Modeling in Recommendation System
- Explainable Product Search with a Dynamic Relation Embedding Model
- Generating Query Focused Summaries from Query-Free Resources
- Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question Answering
- LATTE: Latent Type Modeling for Biomedical Entity Linking
- NExT-Search: Rebuilding User Feedback Ecosystem for Generative AI Search
- RLTM: An Efficient Neural IR Framework for Long Documents
- Getting Started with Neural Models for Semantic Matching in Web Search
- ICS-Assist: Intelligent Customer Inquiry Resolution Recommendation in Online Customer Service for Large E-Commerce Businesses
- Keyword Extraction for Improved Document Retrieval in Conversational Search
- Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots
- Heterogeneous Network Embedding for Deep Semantic Relevance Match in E-commerce Search
- Context Attentive Document Ranking and Query Suggestion
- BanditRank: Learning to Rank Using Contextual Bandits
- Learning Fine-grained Fact-Article Correspondence in Legal Cases
- IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems
- QDER: Query-Specific Document and Entity Representations for Multi-Vector Document Re-Ranking
- Leveraging Advantages of Interactive and Non-Interactive Models for Vector-Based Cross-Lingual Information Retrieval
- Modeling Relevance Ranking under the Pre-training and Fine-tuning Paradigm
- Self-supervised Answer Retrieval on Clinical Notes
- GazBy: Gaze-Based BERT Model to Incorporate Human Attention in Neural Information Retrieval
- Which Neurons Matter in IR? Applying Integrated Gradients-based Methods to Understand Cross-Encoders
- Towards Lossless Token Pruning in Late-Interaction Retrieval Models
- Neural Ranking Models with Multiple Document Fields
- Long Document Ranking with Query-Directed Sparse Transformer
- Patient Cohort Retrieval using Transformer Language Models
- MRNN: A Multi-Resolution Neural Network with Duplex Attention for Document Retrieval in the Context of Question Answering
- Separate and Attend in Personal Email Search
- Biomedical Evidence Generation Engine
- Curriculum Learning Strategies for IR: An Empirical Study on Conversation Response Ranking
- Impact of Training Dataset Size on Neural Answer Selection Models
- Luandri: a Clean Lua Interface to the Indri Search Engine
- Toward the Understanding of Deep Text Matching Models for Information Retrieval
- An In-depth Analysis of Passage-Level Label Transfer for Contextual Document Ranking
- Pre-training for Ad-hoc Retrieval: Hyperlink is Also You Need
- Towards Theoretical Understanding of Weak Supervision for Information Retrieval
- WIKIR: A Python toolkit for building a large-scale Wikipedia-based English Information Retrieval Dataset
- DQNC2S: DQN-based Cross-stream Crisis event Summarizer
- Few-Shot Text Ranking with Meta Adapted Synthetic Weak Supervision
- Recent Advances in Automated Question Answering In Biomedical Domain
- Fine-tune BERT for E-commerce Non-Default Search Ranking
- Consistency and Variation in Kernel Neural Ranking Model
- Embedding-based Product Retrieval in Taobao Search
- Pre-trained Language Model based Ranking in Baidu Search
- Finding Salient Context based on Semantic Matching for Relevance Ranking
- GLOW : Global Weighted Self-Attention Network for Web Search
- DeText: A Deep Text Ranking Framework with BERT
- Investigating the Robustness of Counterfactual Learning to Rank Models: A Reproducibility Study
- REGMAPR - Text Matching Made Easy
- Optimize What You Evaluate With: A Simple Yet Effective Framework For Direct Optimization Of IR Metrics
- Neural Relation Prediction for Simple Question Answering over Knowledge Graph
- A unified Neural Network Approach to E-CommerceRelevance Learning
- Practical User Feedback-driven Internal Search Using Online Learning to Rank
- BERT Embeddings Can Track Context in Conversational Search
- Searching Personal Collections
- LRG at TREC 2020: Document Ranking with XLNet-Based Models
- Fake News Data Collection and Classification: Iterative Query Selection for Opaque Search Engines with Pseudo Relevance Feedback
- Embracing Structure in Data for Billion-Scale Semantic Product Search
- Exploiting Sentence-Level Representations for Passage Ranking
- YES SIR!Optimizing Semantic Space of Negatives with Self-Involvement Ranker
- Modularized Transfomer-based Ranking Framework
- Gender Stereotype Reinforcement: Measuring the Gender Bias Conveyed by Ranking Algorithms
- PT-Ranking: A Benchmarking Platform for Neural Learning-to-Rank
- Place Deduplication with Embeddings
- Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations
- Personalizing Search Results Using Hierarchical RNN with Query-aware Attention
- Neural Document Expansion with User Feedback
- More Robust Dense Retrieval with Contrastive Dual Learning
- Neural Search: Learning Query and Product Representations in Fashion E-commerce
- MIRA: Leveraging Multi-Intention Co-click Information in Web-scale Document Retrieval using Deep Neural Networks
- Cross-language Citation Recommendation via Hierarchical Representation Learning on Heterogeneous Graph
- Learning Fast Matching Models from Weak Annotations
- Attentive Long Short-Term Preference Modeling for Personalized Product Search
- Text-to-Text Multi-view Learning for Passage Re-ranking
- Graph-based Multilingual Product Retrieval in E-commerce Search
- Cross-language Information Retrieval
- Deep Natural Language Processing for LinkedIn Search
- TPRM: A Topic-based Personalized Ranking Model for Web Search
- AutoSUM: Automating Feature Extraction and Multi-user Preference Simulation for Entity Summarization
- Cross-Modality Relevance for Reasoning on Language and Vision
- Towards Deep and Representation Learning for Talent Search at LinkedIn