4 papers
Enhancing SignSGD: Small-Batch Convergence Analysis and a Hybrid Switching Strategy
Haoran Chen, Wentao Wang
SignSGD compresses each stochastic gradient coordinate to a single bit, offering substantial memory and communication savings, but its 1-bit quantization removes magnitude informat…
Lightweight Multimodal Adaptation of Vision Language Models for Species Recognition and Habitat Context Interpretation in Drone Thermal Imagery
Hao Chen, Fang Qiu, Fangchao Dong +3
This study proposes a lightweight multimodal adaptation framework to bridge the representation gap between RGB-pretrained VLMs and thermal infrared imagery, and demonstrates its pr…
Revisit Modality Imbalance at the Decision Layer
Xiaoyu Ma, Hao Chen
Multimodal learning integrates information from different modalities to enhance model performance, yet it often suffers from modality imbalance, where dominant modalities overshado…
Mixup Helps Understanding Multimodal Video Better
Xiaoyu Ma, Ding Ding, Hao Chen
Multimodal video understanding plays a crucial role in tasks such as action recognition and emotion classification by combining information from different modalities. However, mult…