From the 1 of 5 linked papers with an AI index.
5 papers
PhiZero: A World Model Built Around Physical Language
Shuyao Shang, Yuqi Wang, Ruopeng Gao +4
PhiZero is a physical world model that learns a compact discrete "physical language" from videos to predict future world states as language sequences before rendering them into rea…
UniDDT: Unifying Multimodal Understanding and Generation with Decoupled Diffusion Transformer
Shuai Wang, Liang Li, Yang Chen +3
Unified Multimodal Models (UMMs) have emerged as a critical direction for general-purpose multimodal intelligence, integrating understanding and generation into a single framework.…
Reasoning Guided Embeddings: Leveraging MLLM Reasoning for Improved Multimodal Retrieval
Chunxu Liu, Jiyuan Yang, Ruopeng Gao +4
Multimodal embeddings are widely used in downstream tasks such as multimodal retrieval, enabling alignment of interleaved modalities in a shared representation space. While recent…
Multiple Object Tracking as ID Prediction
Ruopeng Gao, Ji Qi, Limin Wang
Multi-Object Tracking (MOT) has been a long-standing challenge in video understanding. A natural and intuitive approach is to split this task into two parts: object detection and a…
History-Aware Transformation of ReID Features for Multiple Object Tracking
Ruopeng Gao, Yuyao Wang, Chunxu Liu +1
In Multiple Object Tracking (MOT), Re-identification (ReID) features are widely employed as a powerful cue for object association. However, they are often wielded as a one-size-fit…