4 papers
PerspAct: Enhancing LLM Situated Collaboration Skills through Perspective Taking and Active Vision
Sabrina Patania, Luca Annese, Anita Pellegrini +8
Recent advances in Large Language Models (LLMs) and multimodal foundation models have significantly broadened their application in robotics and collaborative systems. However, effe…
SCOOP: A Framework for Proactive Collaboration and Social Continual Learning through Natural Language Interaction andCausal Reasoning
Dimitri Ognibene, Sabrina Patania, Luca Annese +5
Multimodal information-gathering settings, where users collaborate with AI in dynamic environments, are increasingly common. These involve complex processes with textual and multim…
One to rule them all: natural language to bind communication, perception and action
Simone Colombani, Dimitri Ognibene, Giuseppe Boccignone
In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynami…
Time is on my sight: scene graph filtering for dynamic environment perception in an LLM-driven robot
Simone Colombani, Luca Brini, Dimitri Ognibene +1
Robots are increasingly being used in dynamic environments like workplaces, hospitals, and homes. As a result, interactions with robots must be simple and intuitive, with robots pe…