6 papers
Learning Subspace-Preserving Sparse Attention Graphs from Heterogeneous Multiview Data
Jie Chen, Yuanbiao Gou, Chuanbin Liu +2
The high-dimensional features extracted from large-scale unlabeled data via various pretrained models with diverse architectures are referred to as heterogeneous multiview data. Mo…
From Evaluation to Defense: Advancing Safety in Video Large Language Models
Yiwei Sun, Peiqi Jiang, Chuanbin Liu +3
While the safety risks of image-based large language models (Image LLMs) have been extensively studied, their video-based counterparts (Video LLMs) remain critically under-examined…
Decoupling Perception from Reasoning for Hallucination-Resistant Video Understanding
Bowei Pu, Chuanbin Liu, Yifan Ge +5
Video Large Language Models improve reasoning over complex videos by generating intermediate reasoning text. However, reliable reasoning depends on accurate video perception. In ex…
RegionRAG: Region-level Retrieval-Augmented Generation for Visual Document Understanding
Yinglu Li, Zhiying Lu, Zhihang Liu +3
Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the en…
PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Rendering
Yifan Gao, Zihang Lin, Chuanbin Liu +4
Product posters, which integrate subject, scene, and text, are crucial promotional tools for attracting customers. Creating such posters using modern image generation methods is va…
Hybrid-Level Instruction Injection for Video Token Compression in Multi-modal Large Language Models
Zhihang Liu, Chen-Wei Xie, Pandeng Li +5
Recent Multi-modal Large Language Models (MLLMs) have been challenged by the computational overhead resulting from massive video frames, often alleviated through compression strate…