4 papers
WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models
Hongjin Chen, Shangyun Jiang, Tonghua Su +4
Vision-language models (VLMs) and generative world models are opening new opportunities for embodied navigation. VLMs are increasingly used as direct planners or trajectory predict…
OmniTrace: A Unified Framework for Generation-Time Attribution in Omni-Modal LLMs
Qianqi Yan, Yichen Guo, Ching-Chen Kuo +4
Modern multimodal large language models (MLLMs) generate fluent responses from interleaved text, image, audio, and video inputs. However, identifying which input sources support ea…
Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models
Qianqi Yan, Yue Fan, Hongquan Li +5
Existing Multimodal Large Language Models (MLLMs) are predominantly trained and tested on consistent visual-textual inputs, leaving open the question of whether they can handle inc…
Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding
Yue Fan, Lei Ding, Ching-Chen Kuo +6
Graphical User Interfaces (GUIs) are central to our interaction with digital devices and growing efforts have been made to build models for various GUI understanding tasks. However…