1.2k citations · 2.5k across the 21 of their papers we have counts for
13 papers · 1 filter
Large Dual Encoders Are Generalizable Retrievers
Jianmo Ni, Chen Qu, Jing Lu +8
It has been shown that dual encoders trained on one domain often fail to generalize to other domains for retrieval tasks. One widespread belief is that the bottleneck layer of a du…
COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
Luyu Gao, Zhuyun Dai, Jamie Callan
Classical information retrieval systems such as BM25 rely on exact lexical match and carry out search efficiently with inverted list index. Recent neural IR models shifts towards s…
Rethink Training of BERT Rerankers in Multi-Stage Retrieval Pipeline
Luyu Gao, Zhuyun Dai, Jamie Callan
Pre-trained deep language models~(LM) have advanced the state-of-the-art of text retrieval. Rerankers fine-tuned from deep LM estimates candidate relevance based on rich contextual…
PGT: Pseudo Relevance Feedback Using a Graph-Based Transformer
HongChien Yu, Zhuyun Dai, Jamie Callan
Most research on pseudo relevance feedback (PRF) has been done in vector space and probabilistic retrieval models. This paper shows that Transformer-based rerankers can also benefi…
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun +7
Neural rankers based on deep pretrained language models (LMs) have been shown to improve many information retrieval benchmarks. However, these methods are affected by their the cor…
Understanding BERT Rankers Under Distillation
Luyu Gao, Zhuyun Dai, Jamie Callan
Deep language models such as BERT pre-trained on large corpus have given a huge performance boost to the state-of-the-art information retrieval ranking systems. Knowledge embedded…
Summarizing and Exploring Tabular Data in Conversational Search
Shuo Zhang, Zhuyun Dai, Krisztian Balog +1
Tabular data provide answers to a significant portion of search queries. However, reciting an entire result table is impractical in conversational search systems. We propose to gen…
Complementing Lexical Retrieval with Semantic Residual Embedding
Luyu Gao, Zhuyun Dai, Tongfei Chen +3
This paper presents CLEAR, a retrieval model that seeks to complement classical lexical exact-match models such as BM25 with semantic matching signals from a neural embedding match…
Modularized Transfomer-based Ranking Framework
Luyu Gao, Zhuyun Dai, Jamie Callan
Recent innovations in Transformer-based ranking models have advanced the state-of-the-art in information retrieval. However, these Transformers are computationally expensive, and t…
Context-Aware Sentence/Passage Term Importance Estimation For First Stage Retrieval
Zhuyun Dai, Jamie Callan
Term frequency is a common method for identifying the importance of a term in a query or document. But it is a weak signal, especially when the frequency distribution is flat, such…
Deeper Text Understanding for IR with Contextual Neural Language Modeling
Zhuyun Dai, Jamie Callan
Neural networks provide new possibilities to automatically learn complex language patterns and query-document relations. Neural IR models have achieved promising results in learnin…
Consistency and Variation in Kernel Neural Ranking Model
Mary Arpita Pyreddy, Varshini Ramaseshan, Narendra Nath Joshi +4
This paper studies the consistency of the kernel-based neural ranking model K-NRM, a recent state-of-the-art neural IR model, which is important for reproducible research and deplo…
End-to-End Neural Ad-hoc Ranking with Kernel Pooling
Chenyan Xiong, Zhuyun Dai, Jamie Callan +2
This paper proposes K-NRM, a kernel based neural model for document ranking. Given a query and a set of documents, K-NRM uses a translation matrix that models word-level similariti…