4 papers
Global-Local Dual Perception for MLLMs in High-Resolution Text-Rich Image Translation
Junxin Lu, Tengfei Song, Zhanglin Wu +9
Text Image Machine Translation (TIMT) aims to translate text embedded in images in the source-language into target-language, requiring synergistic integration of visual perception…
Multimodal Machine Translation with Visual Scene Graph Pruning
Chenyu Lu, Shiliang Sun, Jing Zhao +3
Multimodal machine translation (MMT) seeks to address the challenges posed by linguistic polysemy and ambiguity in translation tasks by incorporating visual information. A key bott…
Evaluating Menu OCR and Translation: A Benchmark for Aligning Human and Automated Evaluations in Large Vision-Language Models
Zhanglin Wu, Tengfei Song, Ning Xie +8
The rapid advancement of large vision-language models (LVLMs) has significantly propelled applications in document understanding, particularly in optical character recognition (OCR…
Memory Reviving, Continuing Learning and Beyond: Evaluation of Pre-trained Encoders and Decoders for Multimodal Machine Translation
Zhuang Yu, Shiliang Sun, Jing Zhao +2
Multimodal Machine Translation (MMT) aims to improve translation quality by leveraging auxiliary modalities such as images alongside textual input. While recent advances in large-s…