works on

From the 1 of 27 linked papers with an AI index.

activity
20162023
most citedREALM: Retrieval-Augmented Language Model Pre-Training

521 citations · 1.6k across the 20 of their papers we have counts for

collaborators
Showing 2020Show all

5 papers · 1 filter

cs.CL2020★ 4 cited

CapWAP: Captioning with a Purpose

Adam Fisch, Kenton Lee, Ming-Wei Chang +2

The traditional image captioning task uses generic reference captions to provide textual information about images. Different user populations, however, will care about different vi…

cs.CL2020★ 5 cited

XOR QA: Cross-lingual Open-Retrieval Question Answering

Akari Asai, Jungo Kasai, Jonathan H. Clark +3

Multilingual question answering tasks typically assume answers exist in the same language as the question. Yet in practice, many languages face both information scarcity -- where l…

cs.CL2020★ 13 cited

Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering

Hao Cheng, Ming-Wei Chang, Kenton Lee +1

We address the problem of extractive question answering using document-level distant super-vision, pairing questions and relevant documents with answer strings. We compare previous…

cs.CL2020★ 22 cited

Contextualized Representations Using Textual Encyclopedic Knowledge

Mandar Joshi, Kenton Lee, Yi Luan +1

We present a method to represent input texts by contextualizing them jointly with dynamically retrieved textual encyclopedic background knowledge from multiple documents. We apply…

cs.CL2020★ 521 cited

REALM: Retrieval-Augmented Language Model Pre-Training

Kelvin Guu, Kenton Lee, Zora Tung +2

The paper introduces REALM, a language model that retrieves relevant documents from a large corpus during pre‑training and inference, enabling it to use external knowledge for task…