21 citations · 118 across the 15 of their papers we have counts for
5 papers · 1 filter
DreamFormer: Dream Imitation with a Transformer World Model for Language-Conditioned Robotic Manipulation
Mostafa Kotb, Cornelius Weber, Muhammad Burhan Hafez +1
We introduce DreamFormer, a model-based agent that acquires language-conditioned, multi-task skills by imitating expert demonstrations within the latent imagination of a learned wo…
REDACT: Robust Perceptive Locomotion under Unseen Visual Corruption
Natapat Kirdwichai, Tobias Driskell-Poole, Andrei Sontea +3
Depth-conditioned locomotion policies have demonstrated impressive agile maneuvers, but can be steered to unpredictable actions when observations are outside their training distrib…
Continual Robot Learning using Self-Supervised Task Inference
Muhammad Burhan Hafez, Stefan Wermter
Endowing robots with the human ability to learn a growing set of skills over the course of a lifetime as opposed to mastering single tasks is an open problem in robot learning. Whi…
Chat with the Environment: Interactive Multimodal Perception Using Large Language Models
Xufeng Zhao, Mengdi Li, Cornelius Weber +2
Programming robot behavior in a complex world faces challenges on multiple levels, from dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large Lan…
Impact Makes a Sound and Sound Makes an Impact: Sound Guides Representations and Explorations
Xufeng Zhao, Cornelius Weber, Muhammad Burhan Hafez +1
Sound is one of the most informative and abundant modalities in the real world while being robust to sense without contacts by small and cheap sensors that can be placed on mobile…