5 papers
S-VLA: State-Space Guided Vision-Language-Action Models for Long-Horizon Manipulation
Zhipeng Xie, Zongyi Han, Xiangyi Wei +3
Vision-Language-Action (VLA) models have demonstrated strong capabilities in robotic manipulation, but their performance degrades significantly in long-horizon tasks due to cumulat…
Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation
Junxin Lu, Tengfei Song, Zhanglin Wu +9
Text Image Machine Translation (TIMT) aims to translate text embedded in images in the source-language into target-language, requiring synergistic integration of visual perception…
LEMON: How Well Do MLLMs Perform Temporal Multimodal Understanding on Instructional Videos?
Zhuang Yu, Lei Shen, Jing Zhao +1
Recent multimodal large language models (MLLMs) have shown remarkable progress across vision, audio, and language tasks, yet their performance on long-form, knowledge-intensive, an…
Multimodal Machine Translation with Visual Scene Graph Pruning
Chenyu Lu, Shiliang Sun, Jing Zhao +3
Multimodal machine translation (MMT) seeks to address the challenges posed by linguistic polysemy and ambiguity in translation tasks by incorporating visual information. A key bott…
Memory Reviving, Continuing Learning and Beyond: Evaluation of Pre-trained Encoders and Decoders for Multimodal Machine Translation
Zhuang Yu, Shiliang Sun, Jing Zhao +2
Multimodal Machine Translation (MMT) aims to improve translation quality by leveraging auxiliary modalities such as images alongside textual input. While recent advances in large-s…