3.4k citations · 4.7k across the 28 of their papers we have counts for
5 papers · 1 filter
HoME: a Household Multimodal Environment
Simon Brodeur, Ethan Perez, Ankesh Anand +6
We introduce HoME: a Household Multimodal Environment for artificial agents to learn from vision, audio, semantics, physics, and interaction with objects and other agents, all with…
FiLM: Visual Reasoning with a General Conditioning Layer
Ethan Perez, Florian Strub, Harm de Vries +2
We introduce a general-purpose conditioning method for neural networks called FiLM: Feature-wise Linear Modulation. FiLM layers influence neural network computation via a simple, f…
Learning Visual Reasoning Without Strong Priors
Ethan Perez, Harm de Vries, Florian Strub +2
Achieving artificial visual reasoning - the ability to answer image-related questions which require a multi-step, high-level process - is an important step towards artificial gener…
Modulating early visual processing by language
Harm de Vries, Florian Strub, Jérémie Mary +3
It is commonly assumed that language refers to high-level visual concepts while leaving low-level visual processing unaffected. This view dominates the current literature in comput…
End-to-end optimization of goal-driven and visually grounded dialogue systems
Florian Strub, Harm de Vries, Jeremie Mary +3
End-to-end design of dialogue systems has recently become a popular research topic thanks to powerful tools such as encoder-decoder architectures for sequence-to-sequence learning.…