15 papers
Multimodal Large Language Models for Real-Time Situated Reasoning
Giulio Antonio Abbo, Senne Lenaerts, Tony Belpaeme
In this work, we explore how multimodal large language models can support real-time context- and value-aware decision-making. To do so, we combine the GPT-4o language model with a…
Fast Multi-Party Open-Ended Conversation with a Social Robot
Giulio Antonio Abbo, Maria Jose Pinto-Bernal, Martijn Catrycke +1
Multi-party open-ended conversation remains a major challenge in human-robot interaction, particularly when robots must recognise speakers, allocate turns, and respond coherently u…
Concerns and Values in Human-Robot Interactions: A Focus on Social Robotics
Giulio Antonio Abbo, Tony Belpaeme, Micol Spitale
Robots, as AI with physical instantiation, inhabit our social and physical world, where their actions have both social and physical consequences, posing challenges for researchers…
Prompt-Based Value Steering of Large Language Models
Giulio Antonio Abbo, Tony Belpaeme
Large language models are increasingly used in applications where alignment with human values is critical. While model fine-tuning is often employed to ensure safe responses, this…
If They Disagree, Will You Conform? Exploring the Role of Robots' Value Awareness in a Decision-Making Task
Giulia Pusceddu, Giulio Antonio Abbo, Francesco Rea +2
This study investigates whether the opinions of robotic agents can influence human decision-making when robots display value awareness (i.e., the capability of understanding human…
Touch Speaks, Sound Feels: A Multimodal Approach to Affective and Social Touch from Robots to Humans
Qiaoqiao Ren, Tony Belpaeme
Affective tactile interaction constitutes a fundamental component of human communication. In natural human-human encounters, touch is seldom experienced in isolation; rather, it is…