Balancing Multimodal Learning via Functional Progress

Zhongjing Gu, Fengqiang Wan, Yiming Cui +2

Multimodal learning often suffers from modality imbalance, where the joint optimization process is dominated by a single modality. Existing methods typically estimate modality imba…