activity
20202026
most citedLaMI: Large Language Models for Multi-Modal Human-Robot Interaction

72 citations · 136 across the 8 of their papers we have counts for

collaborators

8 papers

cs.RO2026

MERGE: Guided Vision-Language Models for Multi-Actor Event Reasoning and Grounding in Human-Robot Interaction

Joerg Deigmoeller, Nakul Agarwal, Stephan Hasler +8

We introduce MERGE, a system for situational grounding of actors, objects, and events in dynamic human-robot group interactions. Effective collaboration in such settings requires c…

cs.RO2025

CARMA: Context-Aware Situational Grounding of Human-Robot Group Interactions by Combining Vision-Language Models with Object and Action Recognition

Joerg Deigmoeller, Stephan Hasler, Nakul Agarwal +8

We introduce CARMA, a system for situational grounding in human-robot group interactions. Effective collaboration in such group settings requires situational awareness based on a c…

cs.RO2024★ 16 cited

To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions

Daniel Tanneberg, Felix Ocker, Stephan Hasler +6

How can a robot provide unobtrusive physical support within a group of humans? We present Attentive Support, a novel interaction concept for robots to support a group of humans. It…

cs.RO2024★ 72 cited

LaMI: Large Language Models for Multi-Modal Human-Robot Interaction

Chao Wang, Stephan Hasler, Daniel Tanneberg +5

This paper presents an innovative large language model (LLM)-based robotic system for enhancing multi-modal human-robot interaction (HRI). Traditional HRI systems relied on complex…

cs.RO2023★ 31 cited

CoPAL: Corrective Planning of Robot Actions with Large Language Models

Frank Joublin, Antonello Ceravola, Pavel Smirnov +7

In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable ch…

cs.AI2023★ 13 cited

A Glimpse in ChatGPT Capabilities and its impact for AI research

Frank Joublin, Antonello Ceravola, Joerg Deigmoeller +3

Large language models (LLMs) have recently become a popular topic in the field of Artificial Intelligence (AI) research, with companies such as Google, Amazon, Facebook, Amazon, Te…

cs.HC2022★ 3 cited

A User Interface for Sense-making of the Reasoning Process while Interacting with Robots

Chao Wang, Joerg Deigmoeller

As knowledge graph has the potential to bridge the gap between commonsense knowledge and reasoning over actionable capabilities of mobile robotic platforms, incorporating knowledge…

cs.HC2020★ 1 cited

Designing Interaction for Multi-agent Cooperative System in an Office Environment

Chao Wang, Stephan Hasler, Manuel Muehlig +4

Future intelligent system will involve very various types of artificial agents, such as mobile robots, smart home infrastructure or personal devices, which share data and collabora…