248 citations · 409 across the 10 of their papers we have counts for
10 papers
RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation
Konstantinos Bousmalis, Giulia Vezzani, Dushyant Rao +36
The ability to leverage heterogeneous robotic experience from different robots and tasks to quickly master novel skills and embodiments has the potential to transform robot learnin…
Unlocking the Power of Representations in Long-term Novelty-based Exploration
Alaa Saade, Steven Kapturowski, Daniele Calandriello +6
We introduce Robust Exploration via Clustering-based Online Density Estimation (RECODE), a non-parametric method for novelty-based exploration that estimates visitation counts for…
Is Curiosity All You Need? On the Utility of Emergent Behaviours from Curious Exploration
Oliver Groth, Markus Wulfmeier, Giulia Vezzani +5
Curiosity-based reward schemes can present powerful exploration mechanisms which facilitate the discovery of solutions for complex, sparse or long-horizon tasks. However, as the ag…
RELATE: Physically Plausible Multi-Object Scene Synthesis Using Structured Latent Spaces
Sebastien Ehrhardt, Oliver Groth, Aron Monszpart +4
We present RELATE, a model that learns to generate physically plausible scenes and videos of multiple interacting objects. Similar to other generative approaches, RELATE is trained…
Goal-Conditioned End-to-End Visuomotor Control for Versatile Skill Primitives
Oliver Groth, Chia-Man Hung, Andrea Vedaldi +1
Visuomotor control (VMC) is an effective means of achieving basic manipulation tasks such as pushing or pick-and-place from raw images. Conditioning VMC on desired goal states is a…
Scrutinizing and De-Biasing Intuitive Physics with Neural Stethoscopes
Fabian B. Fuchs, Oliver Groth, Adam R. Kosiorek +4
Visually predicting the stability of block towers is a popular task in the domain of intuitive physics. While previous work focusses on prediction accuracy, a one-dimensional perfo…
ShapeStacks: Learning Vision-Based Physical Intuition for Generalised Object Stacking
Oliver Groth, Fabian B. Fuchs, Ingmar Posner +1
Physical intuition is pivotal for intelligent agents to perform complex tasks. In this paper we investigate the passive acquisition of an intuitive understanding of physical princi…
Analyzing Modular CNN Architectures for Joint Depth Prediction and Semantic Segmentation
Omid Hosseini Jafari, Oliver Groth, Alexander Kirillov +2
This paper addresses the task of designing a modular neural network architecture that jointly solves different tasks. As an example we use the tasks of depth estimation and semanti…
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Ranjay Krishna, Yuke Zhu, Oliver Groth +9
Despite progress in perceptual tasks such as image classification, computers still perform poorly on cognitive tasks such as image description and question answering. Cognition is…
Visual7W: Grounded Question Answering in Images
Yuke Zhu, Oliver Groth, Michael Bernstein +1
We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the…