Information Retrieval: Recent Advances and Beyond

Abstract

In this paper, we provide a detailed overview of the models used for information retrieval in the first and second stages of the typical processing chain. We discuss the current state-of-the-art models, including methods based on terms, semantic retrieval, and neural. Additionally, we delve into the key topics related to the learning process of these models. This way, this survey offers a comprehensive understanding of the field and is of interest for for researchers and practitioners entering/working in the information retrieval domain.

References in corpus (34)

• Cross-lingual Language Model Pretraining
• A Deep Relevance Matching Model for Ad-hoc Retrieval
• ERNIE: Enhanced Representation through Knowledge Integration
• End-to-End Neural Ad-hoc Ranking with Kernel Pooling
• Deeper Text Understanding for IR with Contextual Neural Language Modeling
• Multi-Stage Document Ranking with BERT
• Understanding the Behaviors of BERT in Ranking
• Simple Applications of BERT for Ad Hoc Document Retrieval
• Context-Aware Sentence/Passage Term Importance Estimation For First Stage Retrieval
• Overview of the TREC 2020 deep learning track
• Zero-shot Text Classification With Generative Language Models
• Few-Shot Conversational Dense Retrieval
• Expansion via Prediction of Importance with Contextualization
• A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniques
• RepBERT: Contextualized Text Embeddings for First-Stage Retrieval
• Efficient Document Re-Ranking for Transformers by Precomputing Term Representations
• SparTerm: Learning Term-based Sparse Representation for Fast Text Retrieval
• Pseudo-Relevance Feedback for Multiple Representation Dense Retrieval
• ST-MoE: Designing Stable and Transferable Sparse Expert Models
• Fast Passage Re-ranking with Contextualized Exact Term Matching and Efficient Passage Expansion
• An Updated Duet Model for Passage Re-ranking
• Embedding-based Zero-shot Retrieval through Query Generation
• Joint Learning of Deep Retrieval Model and Product Quantization based Embedding Index
• Off the Beaten Path: Let's Replace Term-Based Retrieval with k-NN Search
• Incorporating Query Term Independence Assumption for Efficient Retrieval and Ranking using Deep Neural Networks
• RLIRank: Learning to Rank with Reinforcement Learning for Dynamic Search
• Match-Tensor: a Deep Relevance Model for Search
• SpaDE: Improving Sparse Representations using a Dual Document Encoder for First-stage Retrieval
• Learning-to-Rank at the Speed of Sampling: Plackett-Luce Gradient Estimation With Minimal Computational Complexity
• DynamicRetriever: A Pre-training Model-based IR System with Neither Sparse nor Dense Index
• Scattered or Connected? An Optimized Parameter-efficient Tuning Approach for Information Retrieval
• Densifying Sparse Representations for Passage Retrieval by Representational Slicing
• EmbedDistill: A Geometric Knowledge Distillation for Information Retrieval
• A Discriminative Semantic Ranker for Question Retrieval

Cited by in corpus (4)

• A Survey on Retrieval And Structuring Augmented Generation with Large Language Models
• Bias-Aware Agent: Enhancing Fairness in AI-Driven Knowledge Retrieval
• From Bugs to Benefits: Improving User Stories by Leveraging Crowd Knowledge with CrUISE-AC
• ReCap: Event-Aware Image Captioning with Article Retrieval and Semantic Gaussian Normalization