242 citations · 1.5k across the 60 of their papers we have counts for
4 papers · 1 filter
Modeling Relationships in Referential Expressions with Compositional Modular Networks
Ronghang Hu, Marcus Rohrbach, Jacob Andreas +2
People often refer to entities in an image in terms of their relationships with other entities. For example, "the black cat sitting under the table" refers to both a "black cat" en…
Modular Multitask Reinforcement Learning with Policy Sketches
Jacob Andreas, Dan Klein, Sergey Levine
We describe a framework for multitask deep reinforcement learning guided by policy sketches. Sketches annotate tasks with sequences of named subtasks, providing information about h…
Reasoning About Pragmatics with Neural Listeners and Speakers
Jacob Andreas, Dan Klein
We present a model for pragmatically describing scenes, in which contrastive behavior results from a combination of inference-driven pragmatics and learned semantics. Like previous…
Learning to Compose Neural Networks for Question Answering
Jacob Andreas, Marcus Rohrbach, Trevor Darrell +1
We describe a question answering model that applies to both images and structured knowledge bases. The model uses natural language strings to automatically assemble neural networks…