6 papers
Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation
Yilong Wang, Cheng Qian, Edward Johns
Deformable object manipulation (DOM) is challenging due to high-dimensional, partially observable states that evolve through long-horizon, topology-changing interactions with multi…
Observer-Actor: Active Vision Imitation Learning with Sparse-View Gaussian Splatting
Yilong Wang, Cheng Qian, Ruomeng Fan +1
We propose Observer Actor (ObAct), a novel framework for active vision imitation learning in which the observer moves to optimal visual observations for the actor. We study ObAct o…
Learning a Thousand Tasks in a Day
Kamil Dreczkowski, Pietro Vitiello, Vitalis Vosylius +1
Humans are remarkably efficient at learning tasks from demonstrations, but today's imitation learning methods for robot manipulation often require hundreds or thousands of demonstr…
Neural Stochastic Flows: Solver-Free Modelling and Inference for SDE Solutions
Naoki Kiyohara, Edward Johns, Yingzhen Li
Stochastic differential equations (SDEs) are well suited to modelling noisy and irregularly sampled time series found in finance, physics, and machine learning. Traditional approac…
Learning in ImaginationLand: Omnidirectional Policies through 3D Generative Models (OP-Gen)
Yifei Ren, Edward Johns
Recent 3D generative models, which are capable of generating full object shapes from just a few images, now open up new opportunities in robotics. In this work, we show that 3D gen…
Instant Policy: In-Context Imitation Learning via Graph Diffusion
Vitalis Vosylius, Edward Johns
Following the impressive capabilities of in-context learning with large transformers, In-Context Imitation Learning (ICIL) is a promising opportunity for robotics. We introduce Ins…