59 citations · 133 across the 10 of their papers we have counts for
10 papers
MERGE: Guided Vision-Language Models for Multi-Actor Event Reasoning and Grounding in Human-Robot Interaction
Joerg Deigmoeller, Nakul Agarwal, Stephan Hasler +8
We introduce MERGE, a system for situational grounding of actors, objects, and events in dynamic human-robot group interactions. Effective collaboration in such settings requires c…
XR: An Extended Reality Platform for Social-Physical Human-Robot Interaction
Chao Wang, Anna Belardinelli, Michael Gienger
Social-physical human-robot interaction (spHRI) is difficult to study: building and programming robots that integrate multiple interaction modalities is costly and slow, while VR-b…
CARMA: Context-Aware Situational Grounding of Human-Robot Group Interactions by Combining Vision-Language Models with Object and Action Recognition
Joerg Deigmoeller, Stephan Hasler, Nakul Agarwal +8
We introduce CARMA, a system for situational grounding in human-robot group interactions. Effective collaboration in such group settings requires situational awareness based on a c…
SemanticScanpath: Combining Gaze and Speech for Situated Human-Robot Interaction Using LLMs
Elisabeth Menendez, Michael Gienger, Santiago Martínez +2
Large Language Models (LLMs) have substantially improved the conversational capabilities of social robots. Nevertheless, for an intuitive and fluent human-robot interaction, robots…
To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions
Daniel Tanneberg, Felix Ocker, Stephan Hasler +6
How can a robot provide unobtrusive physical support within a group of humans? We present Attentive Support, a novel interaction concept for robots to support a group of humans. It…
CoPAL: Corrective Planning of Robot Actions with Large Language Models
Frank Joublin, Antonello Ceravola, Pavel Smirnov +7
In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable ch…
Communicating Robot's Intentions while Assisting Users via Augmented Reality
Chao Wang, Theodoros Stouraitis, Anna Belardinelli +2
This paper explores the challenges faced by assistive robots in effectively cooperating with humans, requiring them to anticipate human behavior, predict their actions' impact, and…
Gaze-based intention estimation: principles, methodologies, and applications in HRI
Anna Belardinelli
Intention prediction has become a relevant field of research in Human-Machine and Human-Robot Interaction. Indeed, any artificial system (co)-operating with and along humans, desig…
Explainable Human-Robot Training and Cooperation with Augmented Reality
Chao Wang, Anna Belardinelli, Stephan Hasler +3
The current spread of social and assistive robotics applications is increasingly highlighting the need for robots that can be easily taught and interacted with, even by users with…
Intention estimation from gaze and motion features for human-robot shared-control object manipulation
Anna Belardinelli, Anirudh Reddy Kondapally, Dirk Ruiken +2
Shared control can help in teleoperated object manipulation by assisting with the execution of the user's intention. To this end, robust and prompt intention estimation is needed,…