6 papers
Pailitao-MMSearch: Building Native E-Commerce Multimodal Search Foundation
Xiaohan Ye, Xu Chen, Zihan Gong +15
The evolution of e-commerce has fundamentally transformed how users search for products, shifting from simple text-based keyword queries to complex multimodal interactions that sea…
MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models
Yuansheng Gao, Wenbin Xing, Jiahao Yuan +4
Video Large Multimodal Models have achieved remarkable progress in video understanding, yet they remain prone to hallucinations, where generated responses are not faithfully suppor…
MOON: Generative MLLM-based Multimodal Representation Learning for E-commerce Product Understanding
Daoze Zhang, Chenghan Fu, Zhanheng Nie +7
With the rapid advancement of e-commerce, exploring general representations rather than task-specific ones has attracted increasing research attention. For product understanding, a…
LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locating
Chao Deng, Jiale Yuan, Pi Bu +8
Large vision language models (LVLMs) have improved the document understanding capabilities remarkably, enabling the handling of complex document elements, longer contexts, and a wi…
Can VLMs Play Action Role-Playing Games? Take Black Myth Wukong as a Study Case
Peng Chen, Pi Bu, Jun Song +2
Recently, large language model (LLM)-based agents have made significant advances across various fields. One of the most popular research areas involves applying these agents to vid…
ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models
Chunjiang Ge, Sijie Cheng, Ziming Wang +6
High-resolution Large Multimodal Models (LMMs) encounter the challenges of excessive visual tokens and quadratic visual complexity. Current high-resolution LMMs address the quadrat…