8 papers · 1 filter
Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning
Zhicheng Zhang, Wentao Gu, Weicheng Wang +5
Omnimodal understanding entails a massive, highly redundant search space of cross-modal interactions, demanding focused and deliberative reasoning. Current reasoning paradigms rely…
LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing
Weicheng Wang, Zhicheng Zhang, Zhongqi Zhang +6
Video editing aims to modify input videos according to user intent. Recently, end-to-end training methods have garnered widespread attention, constructing paired video editing data…
Beyond the Golden Data: Resolving the Motion-Vision Quality Dilemma via Timestep Selective Training
Xiangyang Luo, Qingyu Li, Yuming Li +6
Recent advances in video generation models have achieved impressive results. However, these models heavily rely on the use of high-quality data that combines both high visual quali…
Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddings
Haonan Jiang, Yuji Wang, Yongjie Zhu +5
Leveraging Multimodal Large Language Models (MLLMs) has become pivotal for advancing Universal Multimodal Embeddings (UME) in addressing diverse cross-modal tasks. Recent studies d…
KPM-Bench: A Kinematic Parsing Motion Benchmark for Fine-grained Motion-centric Video Understanding
Boda Lin, Yongjie Zhu, Xiaocheng Gong +2
Despite recent advancements, video captioning models still face significant limitations in accurately describing fine-grained motion details and suffer from severe hallucination is…
Analytic Score Optimization for Multi Dimension Video Quality Assessment
Boda Lin, Yongjie Zhu, Wenyu Qin +2
Video Quality Assessment (VQA) is evolving beyond single-number mean opinion score toward richer, multi-faceted evaluations of video content. In this paper, we present a large-scal…