3 papers
cs.CV2025
Mamba: CLIP-driven Mamba Model for Multi-modal Remote Sensing Classification
Mingxiang Cao, Weiying Xie, Xin Zhang +4
Multi-modal fusion holds great promise for integrating information from different modalities. However, due to a lack of consideration for modal consistency, existing multi-modal fu…
cs.CV2024
DiffCLIP: Few-shot Language-driven Multimodal Classifier
Jiaqing Zhang, Mingxiang Cao, Xue Yang +2
Visual language models like Contrastive Language-Image Pretraining (CLIP) have shown impressive performance in analyzing natural images with language information. However, these mo…
cs.CV2024
SeaDATE: Remedy Dual-Attention Transformer with Semantic Alignment via Contrast Learning for Multimodal Object Detection
Shuhan Dong, Yunsong Li, Weiying Xie +4
Multimodal object detection leverages diverse modal information to enhance the accuracy and robustness of detectors. By learning long-term dependencies, Transformer can effectively…