Confidence Falls Short: Asymmetric Certainty Gains from Optimization Hinder Multimodal Classification

Longfei Huang, Xiangyu Wu, Yang Yang

Multimodal learning (MML) falls into the optimization dilemma due to the modality imbalance phenomenon, leading to suboptimal overall performance in practice. While many attempts p…