5 papers
i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models
Boya Zeng, Tianze Luo, Shu Pu +4
Diffusion models have consistently driven progress in text-to-image generation. However, it is challenging to attribute recent progress to specific modeling and data choices: state…
Video-STR: Reinforcing MLLMs in Video Spatio-Temporal Reasoning with Relation Graph
Wentao Wang, Heqing Zou, Tianze Luo +8
Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated strong semantic understanding capabilities, but struggles to perform precise spatio-temporal understand…
Datasets and Recipes for Video Temporal Grounding via Reinforcement Learning
Ruizhe Chen, Zhiting Fan, Tianze Luo +7
Video Temporal Grounding (VTG) aims to localize relevant temporal segments in videos given natural language queries. Despite recent progress with large vision-language models (LVLM…
HLV-1K: A Large-scale Hour-Long Video Benchmark for Time-Specific Long Video Understanding
Heqing Zou, Tianze Luo, Guiyang Xie +7
Multimodal large language models have become a popular topic in deep visual understanding due to many promising real-world applications. However, hour-long video understanding, spa…
From Seconds to Hours: Reviewing MultiModal Large Language Models on Comprehensive Long Video Understanding
Heqing Zou, Tianze Luo, Guiyang Xie +8
The integration of Large Language Models (LLMs) with visual encoders has recently shown promising performance in visual understanding tasks, leveraging their inherent capability to…