Multimodal Large Language Models for Real-Time Situated Reasoning

Giulio Antonio Abbo, Senne Lenaerts, Tony Belpaeme

In this work, we explore how multimodal large language models can support real-time context- and value-aware decision-making. To do so, we combine the GPT-4o language model with a…