CARD: Diagnosing Belief to Action Routing Failures in Vision Language Models

Souptik Kumar Majumdar, Fabian Kögel, Andreas Bulling

Linear probes and activation steering have uncovered that vision-language models (VLMs) internally represent mental states such as agents' beliefs, knowledge, and intentions. Howev…