Multimodal Fusion via Self-Consistent Task-Gradient Fields

Jiayu Xiong, Jing Wang, Jun Xue +4

Multimodal learning aims to preserve as much task-related information as possible from different inputs. However, current fusion designs often distort the feedback loop to feature…