3 papers
cs.HC2025
LLM-Driven Augmented Reality Puppeteer: Controller-Free Voice-Commanded Robot Teleoperation
Yuchong Zhang, Bastian Orthmann, Michael C. Welle +2
The integration of robotics and augmented reality (AR) presents transformative opportunities for advancing human-robot interaction (HRI) by improving usability, intuitiveness, and…
cs.RO2024
Puppeteer Your Robot: Augmented Reality Leader-Follower Teleoperation
Jonne van Haastregt, Michael C. Welle, Yuchong Zhang +1
High-quality demonstrations are necessary when learning complex and challenging manipulation tasks. In this work, we introduce an approach to puppeteer a robot by controlling a vir…
cs.RO2024
A Robotic Skill Learning System Built Upon Diffusion Policies and Foundation Models
Nils Ingelhag, Jesper Munkeby, Jonne van Haastregt +3
In this paper, we build upon two major recent developments in the field, Diffusion Policies for visuomotor manipulation and large pre-trained multimodal foundational models to obta…