activity
20172023
most citedTransformer Memory as a Differentiable Search Index

82 citations · 224 across the 19 of their papers we have counts for

collaborators
Showing 2022Show all

6 papers · 1 filter

cs.IR2022

Learning List-Level Domain-Invariant Representations for Ranking

Ruicheng Xian, Honglei Zhuang, Zhen Qin +7

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning,…

cs.CL2022★ 27 cited

Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models

Bernd Bohnet, Vinh Q. Tran, Pat Verga +19

Large language models (LLMs) have shown impressive results while requiring little or no direct supervision. Further, there is mounting evidence that LLMs may have potential in info…

cs.IR2022★ 5 cited

RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses

Honglei Zhuang, Zhen Qin, Rolf Jagerman +6

Recently, substantial progress has been made in text ranking based on pretrained language models such as BERT. However, there are limited studies on how to leverage more powerful s…

cs.IR2022★ 1 cited

Retrieval Augmentation for T5 Re-ranker using External Sources

Kai Hui, Tao Chen, Zhen Qin +4

Retrieval augmentation has shown promising improvements in different tasks. However, whether such augmentation can assist a large language model based re-ranker remains unclear. We…

cs.CL2022★ 4 cited

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference

Kai Hui, Honglei Zhuang, Tao Chen +8

State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradig…

cs.CL2022★ 82 cited

Transformer Memory as a Differentiable Search Index

Yi Tay, Vinh Q. Tran, Mostafa Dehghani +10

In this paper, we demonstrate that information retrieval can be accomplished with a single Transformer, in which all information about the corpus is encoded in the parameters of th…