Modality-based Factorization for Multimodal Fusion

Elham J. Barezi, Peyman Momeni, Pascale Fung

We propose a novel method, Modality-based Redundancy Reduction Fusion (MRRF), for understanding and modulating the relative contribution of each modality in multimodal inference ta…