5 papers
A Pairwise Human-Human Interaction Detection and Recognition Framework for Mobile Service Robots
Mengyu Liang, Iolanda Leite, Sarah Gillet
Autonomous mobile service robots, such as lawnmowers or cleaning robots, operating in human-populated environments need to reason about human-human interactions to support safe and…
A Modern System Recipe for Situated Embodied Human-Robot Conversation with Real-Time Multimodal LLMs and Tool-Calling
Dong Won Lee, Sarah Gillet, Louis-Philippe Morency +2
Situated embodied conversation requires robots to interleave real-time dialogue with active perception: deciding what to look at, when to look, and what to say under tight latency…
Ice-Breakers, Turn-Takers and Fun-Makers: Exploring Robots for Groups with Teenagers
Sarah Gillet, Katie Winkle, Giulia Belgiovine +1
Successful, enjoyable group interactions are important in public and personal contexts, especially for teenagers whose peer groups are important for self-identity and self-esteem.…
BT-ACTION: A Test-Driven Approach for Modular Understanding of User Instruction Leveraging Behaviour Trees and LLMs
Alexander Leszczynski, Sarah Gillet, Iolanda Leite +1
Natural language instructions are often abstract and complex, requiring robots to execute multiple subtasks even for seemingly simple queries. For example, when a user asks a robot…
Let's move on: Topic Change in Robot-Facilitated Group Discussions
Georgios Hadjiantonis, Sarah Gillet, Marynel Vázquez +2
Robot-moderated group discussions have the potential to facilitate engaging and productive interactions among human participants. Previous work on topic management in conversationa…