1.7k citations · 2.1k across the 20 of their papers we have counts for
6 papers · 1 filter
Embodied Question Answering
Abhishek Das, Samyak Datta, Georgia Gkioxari +3
We present a new AI task -- Embodied Question Answering (EmbodiedQA) -- where an agent is spawned at a random location in a 3D environment and asked a question ("What color is the…
Evaluating Visual Conversational Agents via Cooperative Human-AI Games
Prithvijit Chattopadhyay, Deshraj Yadav, Viraj Prabhu +5
As AI continues to advance, human-AI teams are inevitable. However, progress in AI is routinely measured in isolation, without a human in the loop. It is crucial to benchmark progr…
Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialog
Satwik Kottur, José M. F. Moura, Stefan Lee +1
A number of recent works have proposed techniques for end-to-end learning of communication protocols among cooperative multi-agent populations, and have simultaneously found the em…
Bidirectional Beam Search: Forward-Backward Inference in Neural Sequence Models for Fill-in-the-Blank Image Captioning
Qing Sun, Stefan Lee, Dhruv Batra
We develop the first approximate inference algorithm for 1-Best (and M-Best) decoding in bidirectional neural sequence models by extending Beam Search (BS) to reason about both for…
The Promise of Premise: Harnessing Question Premises in Visual Question Answering
Aroma Mahendru, Viraj Prabhu, Akrit Mohapatra +2
In this paper, we make a simple observation that questions about images often contain premises - objects and relationships implied by the question - and that reasoning about premis…
Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning
Abhishek Das, Satwik Kottur, José M. F. Moura +2
We introduce the first goal-driven training for visual question answering and dialog agents. Specifically, we pose a cooperative 'image guessing' game between two agents -- Qbot an…