4 papers
BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries
Jiaxin Fang, Ruitong Liu, Zeyu Lai +6
World Action Models (WAMs) commonly couple video and action experts through dense, layer-wise Mixture-of-Transformers (MoT) attention, exposing action prediction to irrelevant visu…
Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
Siyuan Li, Youyuan Zhang, Ruitong Liu +2
Online multimodal knowledge editing requires injecting a continual stream of visual-textual corrections into multimodal large language models (MLLMs) with bounded overhead and mini…
Canvas-of-Thought: Grounding Reasoning via Mutable Structured States
Lingzhuang Sun, Yuxia Zhu, Ruitong Liu +10
While Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), relying solely on linear text sequences re…
Guided Verifier: Collaborative Multimodal Reasoning via Dynamic Process Supervision
Lingzhuang Sun, Ruitong Liu, Yuxia Zhu +5
Reinforcement Learning (RL) has emerged as a pivotal mechanism for enhancing the complex reasoning capabilities of Multimodal Large Language Models (MLLMs). However, prevailing par…