6 papers
SemanticScanpath: Combining Gaze and Speech for Situated Human-Robot Interaction Using LLMs
Elisabeth Menendez, Michael Gienger, Santiago MartÃnez +2
Large Language Models (LLMs) have substantially improved the conversational capabilities of social robots. Nevertheless, for an intuitive and fluent human-robot interaction, robots…
MERGE: Guided Vision-Language Models for Multi-Actor Event Reasoning and Grounding in Human-Robot Interaction
Joerg Deigmoeller, Nakul Agarwal, Stephan Hasler +8
We introduce MERGE, a system for situational grounding of actors, objects, and events in dynamic human-robot group interactions. Effective collaboration in such settings requires c…
XR: An Extended Reality Platform for Social-Physical Human-Robot Interaction
Chao Wang, Anna Belardinelli, Michael Gienger
Social-physical human-robot interaction (spHRI) is difficult to study: building and programming robots that integrate multiple interaction modalities is costly and slow, while VR-b…
CARMA: Context-Aware Situational Grounding of Human-Robot Group Interactions by Combining Vision-Language Models with Object and Action Recognition
Joerg Deigmoeller, Stephan Hasler, Nakul Agarwal +8
We introduce CARMA, a system for situational grounding in human-robot group interactions. Effective collaboration in such group settings requires situational awareness based on a c…
To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions
Daniel Tanneberg, Felix Ocker, Stephan Hasler +6
How can a robot provide unobtrusive physical support within a group of humans? We present Attentive Support, a novel interaction concept for robots to support a group of humans. It…
CoPAL: Corrective Planning of Robot Actions with Large Language Models
Frank Joublin, Antonello Ceravola, Pavel Smirnov +7
In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable ch…