4 papers · 1 filter
Multimodal Continual Instruction Tuning with Dynamic Gradient Guidance
Songze Li, Mingyu Gao, Tonghua Su +2
Multimodal continual instruction tuning enables multimodal large language models to sequentially adapt to new tasks while building upon previously acquired knowledge. However, this…
DUKAE: DUal-level Knowledge Accumulation and Ensemble for Pre-Trained Model-Based Continual Learning
Songze Li, Tonghua Su, Xu-Yao Zhang +2
Pre-trained model-based continual learning (PTMCL) has garnered growing attention, as it enables more rapid acquisition of new knowledge by leveraging the extensive foundational un…
Exploiting Stability-Plasticity Asymmetry in Pretrained Detectors for Incremental Object Detection
Songze Li, Qixing Xu, Tonghua Su +3
Pretrained model-based incremental object detection (PTMIOD) leverages the rich detection priors of pretrained detectors to learn new categories incrementally while preserving dete…
Scene Style Text Editing
Tonghua Su, Fuxiang Yang, Xiang Zhou +3
In this work, we propose a task called "Scene Style Text Editing (SSTE)", changing the text content as well as the text style of the source image while keeping the original text sc…