8 papers
ULME: Predictive Coupling for Mutually Reinforcing Embedding and Language Modeling
Yang Liu, Zhiqiang Yuan, Shu-Dong Huang +5
Text embedding and text generation are two of the most useful capabilities of modern large language models, yet they are typically provided by separate specialized models (an embed…
Evidence-Aligned Multimodal On-Policy Self-Distillation for Fine-Grained Visual Understanding
Nanxing Hu, Qiwei Yan, Jinchao Zhang +1
Fine-grained visual understanding requires models to recognize small details within complex images. Multimodal on-policy self-distillation (OPSD) addresses this challenge by using…
Summarize Before Grounding: Query-Guided Chunk Condensation for Long-Video Temporal Grounding
Nanxing Hu, Xiaoyue Duan, Qiwei Yan +3
Video temporal grounding (VTG) aims to localize the video interval corresponding to a language query. Recent large vision-language models (LVLMs) show great potential in solving su…
RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generation
Qiwei Yan, Zhiqiang Yuan, Chongyang Li +4
Reference-driven image generation has made rapid progress on identity preservation, but reliable viewpoint control across different subjects remains poorly understood. The difficul…
PAL-Bench: Evidence-Grounded Profile Reconstruction from Longitudinal Personal Albums
Qiwei Yan, Zhiqiang Yuan, Zexi Jia +4
Longitudinal personal albums are weak-schema multimodal databases: noisy perceptual records whose key facts require joins across faces, text, timestamps, locations, and repeated ev…
Fine-grained Fragment Retrieval in Multi-modal Long-form Dialogues
Hanbo Bi, Zhiqiang Yuan, Chongyang Li +7
With the widespread adoption of multi-modal communication platforms, long-form dialogues interleaving text and images have become increasingly common. Users often need to retrieve…
PhotoCraft: Agentic Reasoning with Hierarchical Self-Evolving Memory for Deep Image Search
Kailin Lyu, Zhiqiang Yuan, Jianwei He +9
Deep Image Search requires multi-step reasoning over rich contextual cues, such as time, location, and event relations. However, most existing LLM-based agents are stateless and re…
ReCon1M:A Large-scale Benchmark Dataset for Relation Comprehension in Remote Sensing Imagery
Xian Sun, Qiwei Yan, Chubo Deng +8
Scene Graph Generation (SGG) is a high-level visual understanding and reasoning task aimed at extracting entities (such as objects) and their interrelationships from images. Signif…