182 citations · 326 across the 10 of their papers we have counts for
4 papers · 1 filter
From FiLM to Video: Multi-turn Question Answering with Multi-modal Context
Dat Tien Nguyen, Shikhar Sharma, Hannes Schulz +1
Understanding audio-visual content and the ability to have an informative conversation about it have both been challenging areas for intelligent systems. The Audio Visual Scene-awa…
Towards Solving Text-based Games by Producing Adaptive Action Spaces
Ruo Yu Tao, Marc-Alexandre Côté, Xingdi Yuan +1
To solve a text-based game, an agent needs to formulate valid text commands for a given context and find the ones that lead to success. Recent attempts at solving text-based games…
Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz +5
Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from avail…
TextWorld: A Learning Environment for Text-based Games
Marc-Alexandre Côté, Ákos Kádár, Xingdi Yuan +10
We introduce TextWorld, a sandbox learning environment for the training and evaluation of RL agents on text-based games. TextWorld is a Python library that handles interactive play…