5 papers · 1 filter
Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editing
Lecheng Yan, Yichong Zhang, Xiantao Xu +12
Long-form video editing over heterogeneous footage requires agents to coordinate source selection, multimodal analysis, timeline construction, narration and subtitle alignment, ren…
Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation
Xintong Wang, Jingheng Pan, Yixiao Liu +8
Vision-Language Translation (VLT) is a challenging task that requires accurately recognizing multilingual text embedded in images and translating it into the target language with t…
Can Multimodal LLMs do Visual Temporal Understanding and Reasoning? The answer is No!
Mohamed Fazli Imam, Chenyang Lyu, Alham Fikri Aji
Multimodal Large Language Models (MLLMs) have achieved significant advancements in tasks like Visual Question Answering (VQA) by leveraging foundational Large Language Models (LLMs…
CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark
David Romero, Chenyang Lyu, Haryo Akbarianto Wibowo +73
Visual Question Answering (VQA) is an important task in multimodal AI, and it is often used to test the ability of vision-language models to understand and reason on knowledge pres…
GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation
Zhanyu Wang, Longyue Wang, Zhen Zhao +7
While the recent advances in Multimodal Large Language Models (MLLMs) constitute a significant leap forward in the field, these models are predominantly confined to the realm of in…