3 papers
cs.HC2025
Gesture First, LLM-Assisted Voice Complement: Exploring Multimodal Robot 'Puppeteer' Teleoperation Via Virtual Counterpart in Augmented Reality
Yuchong Zhang, Bastian Orthmann, Shichen Ji +3
Robot teleoperation via augmented reality (AR) offers a promising path toward more intuitive human-robot interaction (HRI). We present a head-mounted AR 'puppeteer' system in which…
cs.RO2024
Puppeteer Your Robot: Augmented Reality Leader-Follower Teleoperation
Jonne van Haastregt, Michael C. Welle, Yuchong Zhang +1
High-quality demonstrations are necessary when learning complex and challenging manipulation tasks. In this work, we introduce an approach to puppeteer a robot by controlling a vir…
cs.RO2024
A Robotic Skill Learning System Built Upon Diffusion Policies and Foundation Models
Nils Ingelhag, Jesper Munkeby, Jonne van Haastregt +3
In this paper, we build upon two major recent developments in the field, Diffusion Policies for visuomotor manipulation and large pre-trained multimodal foundational models to obta…