5 papers
PerspAct: Enhancing LLM Situated Collaboration Skills through Perspective Taking and Active Vision
Sabrina Patania, Luca Annese, Anita Pellegrini +8
Recent advances in Large Language Models (LLMs) and multimodal foundation models have significantly broadened their application in robotics and collaborative systems. However, effe…
Growing Perspectives: Modelling Embodied Perspective Taking and Inner Narrative Development Using Large Language Models
Sabrina Patania, Luca Annese, Anna Lambiase +6
Language and embodied perspective taking are essential for human collaboration, yet few computational models address both simultaneously. This work investigates the PerspAct system…
Who Sees What? Structured Thought-Action Sequences for Epistemic Reasoning in LLMs
Luca Annese, Sabrina Patania, Silvia Serino +4
Recent advances in large language models (LLMs) and reasoning frameworks have opened new possibilities for improving the perspective -taking capabilities of autonomous agents. Howe…
AI Pedagogy: Dialogic Social Learning for Artificial Agents
Sabrina Patania, Luca Annese, Cansu Koyuturk +2
Large Language Models (LLMs) have demonstrated remarkable capabilities in processing extensive offline datasets. However, they often face challenges in acquiring and integrating co…
SCOOP: A Framework for Proactive Collaboration and Social Continual Learning through Natural Language Interaction andCausal Reasoning
Dimitri Ognibene, Sabrina Patania, Luca Annese +5
Multimodal information-gathering settings, where users collaborate with AI in dynamic environments, are increasingly common. These involve complex processes with textual and multim…