4 papers
Latent Noise Mask for Reducing Visual Redundancy in Multimodal Large Language Models
Kai Jiang, Ruishu Zhu, Siqi Huang +2
Multimodal large language models (MLLMs) often fail in fine-grained visual reasoning, as question-relevant visual cues are diluted by dense and redundant image tokens. Recent multi…
Multimodal Continual Learning with MLLMs from Multi-scenario Perspectives
Kai Jiang, Siqi Huang, Xiangyu Chen +4
Multimodal large language models (MLLMs) deployed on devices must adapt to continuously changing visual scenarios such as variations in background and perspective, to effectively p…
Mixture of Noise for Pre-Trained Model-Based Class-Incremental Learning
Kai Jiang, Zhengyan Shi, Dell Zhang +2
Class Incremental Learning (CIL) aims to continuously learn new categories while retaining the knowledge of old ones. Pre-trained models (PTMs) show promising capabilities in CIL.…
RS-MoE: A Vision-Language Model with Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering
Hui Lin, Danfeng Hong, Shuhang Ge +4
Remote Sensing Image Captioning (RSIC) presents unique challenges and plays a critical role in applications. Traditional RSIC methods often struggle to produce rich and diverse des…