Unified Multimodal and Multilingual Retrieval via Multi-Task Learning with NLU Integration

Xinyuan Zhang, Lina Zhang, Lisung Chen +6

Multimodal retrieval systems typically employ Vision Language Models (VLMs) that encode images and text independently into vectors within a shared embedding space. Despite incorpor…