5 papers · 1 filter
GUIDE: Guiding Internal Evidence with Language Instructions
Soyeon Caren Han, Hyunsuk Chung, Jinwoo Kim +2
Large multimodal models follow instructions about what to generate, but not necessarily about what evidence to rely on. Hence, models may continue to depend on shortcut-associated…
When Correct Decisions Hide Internal Stress: Decision-State Probing in Multimodal Language Models
Haoran Zhao, Soyeon Caren Han, Eduard Hovy
Multimodal language models are typically evaluated through external behavior: selecting the correct image--text match, rejecting unsupported captions, or answering visual queries c…
Inclusion-of-Thoughts: Mitigating Preference Instability via Purifying the Decision Space
Mohammad Reza Ghasemi Madani, Soyeon Caren Han, Shuo Yang +1
Multiple-choice questions (MCQs) are widely used to evaluate large language models (LLMs). However, LLMs remain vulnerable to the presence of plausible distractors. This often dive…
BRIDGE: Benchmark for multi-hop Reasoning In long multimodal Documents with Grounded Evidence
Biao Xiang, Soyeon Caren Han, Yihao Ding
Multi-hop question answering (QA) is widely used to evaluate the reasoning capabilities of large language models, yet most benchmarks focus on final answer correctness and overlook…
When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
Muku Akasaka, Soyeon Caren Han
Visual spatial reasoning (VSR) remains challenging for modern vision-language models (VLMs), despite advances in multimodal architectures. A common strategy is to inject additional…