activity
20122023
most citedSpeaker-Follower Models for Vision-and-Language Navigation

242 citations · 1.5k across the 60 of their papers we have counts for

collaborators
Showing 2020Show all

9 papers · 1 filter

cs.PL2020★ 3 cited

Representing Partial Programs with Blended Abstract Semantics

Maxwell Nye, Yewen Pu, Matthew Bowers +3

Synthesizing programs from examples requires searching over a vast, combinatorial space of possible programs. In this search process, a key challenge is representing the behavior o…

cs.CL2020★ 10 cited

Learning to Recombine and Resample Data for Compositional Generalization

Ekin Akyürek, Afra Feyza Akyürek, Jacob Andreas

Flexible neural sequence models outperform grammar- and automaton-based counterparts on a variety of tasks. However, neural models perform poorly in settings requiring compositiona…

cs.CL2020★ 20 cited

Task-Oriented Dialogue as Dataflow Synthesis

Semantic Machines, Jacob Andreas, John Bufe +43

We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph. A dialogue agent maps each user utterance to a program that extends th…

cs.CV2020★ 1 cited

Joint Modeling of Chest Radiographs and Radiology Reports for Pulmonary Edema Assessment

Geeticka Chauhan, Ruizhi Liao, William Wells +6

We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiog…

cs.LG2020★ 15 cited

Are Visual Explanations Useful? A Case Study in Model-in-the-Loop Prediction

Eric Chu, Deb Roy, Jacob Andreas

We present a randomized controlled trial for a model-in-the-loop regression task, with the goal of measuring the extent to which (1) good explanations of model predictions increase…

cs.LG2020★ 51 cited

Compositional Explanations of Neurons

Jesse Mu, Jacob Andreas

We describe a procedure for explaining neurons in deep representations by identifying compositional logical concepts that closely approximate neuron behavior. Compared to prior wor…

cs.CL2020★ 19 cited

Unnatural Language Processing: Bridging the Gap Between Synthetic and Natural Language Data

Alana Marzoev, Samuel Madden, M. Frans Kaashoek +2

Large, human-annotated datasets are central to the development of natural language processing models. Collecting these datasets can be the most challenging part of the development…

cs.CL2020

Experience Grounds Language

Yonatan Bisk, Ari Holtzman, Jesse Thomason +9

Language understanding research is held back by a failure to relate language to the physical world it describes and to the social interactions it facilitates. Despite the incredibl…

cs.CL2020★ 72 cited

A Benchmark for Systematic Generalization in Grounded Language Understanding

Laura Ruis, Jacob Andreas, Marco Baroni +2

Humans easily interpret expressions that describe unfamiliar situations composed from familiar parts ("greet the pink brontosaurus by the ferris wheel"). Modern neural networks, by…