works on

From the 1 of 33 linked papers with an AI index.

activity
20152023
most citedREALM: Retrieval-Augmented Language Model Pre-Training

521 citations · 1.5k across the 28 of their papers we have counts for

collaborators
Showing 2021Show all

5 papers · 1 filter

cs.IR2021★ 5 cited

Large Dual Encoders Are Generalizable Retrievers

Jianmo Ni, Chen Qu, Jing Lu +8

It has been shown that dual encoders trained on one domain often fail to generalize to other domains for retrieval tasks. One widespread belief is that the bottleneck layer of a du…

cs.CL2021

FRUIT: Faithfully Reflecting Updated Information in Text

Robert L. Logan, Alexandre Passos, Sameer Singh +1

Textual knowledge bases such as Wikipedia require considerable effort to keep up to date and consistent. While automated writing assistants could potentially ease this burden, the…

cs.CL2021★ 37 cited

Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer

Iulia Turc, Kenton Lee, Jacob Eisenstein +2

Despite their success, large pre-trained multilingual models have not completely alleviated the need for labeled data, which is cumbersome to collect for all target languages. Zero…

cs.CL2021★ 51 cited

Unlocking Compositional Generalization in Pre-trained Models Using Intermediate Representations

Jonathan Herzig, Peter Shaw, Ming-Wei Chang +3

Sequence-to-sequence (seq2seq) models are prevalent in semantic parsing, but have been found to struggle at out-of-distribution compositional generalization. While specialized mode…

cs.CL2021

Joint Passage Ranking for Diverse Multi-Answer Retrieval

Sewon Min, Kenton Lee, Ming-Wei Chang +2

We study multi-answer retrieval, an under-explored problem that requires retrieving passages to cover multiple distinct answers for a given question. This task requires joint model…