4 papers · 1 filter
Enhancing Visual Domain Robustness in Behaviour Cloning via Saliency-Guided Augmentation
Zheyu Zhuang, Ruiyu Wang, Nils Ingelhag +2
In vision-based behavior cloning (BC), conventional image augmentations such as Random Crop and Color Jitter often fall short under substantial visual domain shifts, including chan…
Real-Time Operator Takeover for Visuomotor Diffusion Policy Training
Marco Moletta, Michael C. Welle, Nils Ingelhag +2
We present a Real-Time Operator Takeover (RTOT) paradigm that enables operators to seamlessly take control of a live visuomotor diffusion policy, guiding the system back to desirab…
Feature Extractor or Decision Maker: Rethinking the Role of Visual Encoders in Visuomotor Policies
Ruiyu Wang, Zheyu Zhuang, Shutong Jin +3
An end-to-end (E2E) visuomotor policy is typically treated as a unified whole, but recent approaches using out-of-domain (OOD) data to pretrain the visual encoder have cleanly sepa…
A Robotic Skill Learning System Built Upon Diffusion Policies and Foundation Models
Nils Ingelhag, Jesper Munkeby, Jonne van Haastregt +3
In this paper, we build upon two major recent developments in the field, Diffusion Policies for visuomotor manipulation and large pre-trained multimodal foundational models to obta…