Improving Visual Sensitivity of LLMs on Multimodal Machine Translation with Metric-based Loss Weighting

Paweł Mąka, Piotr Andruszkiewicz, Yusuf Can Semerci +2

Multimodal Machine Translation aims to incorporate additional signal from non-textual modalities to improve translations by resolving ambiguities. While models, through multimodal…