Balancing Multimodal Learning through Label Space Reshaping

Xiaoyu Ma, Weijie Zhang, Yuanhao Gao +3

Multimodal learning often suffers from modality imbalance, where modalities that converge faster dominate optimization while others remain undertrained. Existing approaches typical…