Sparse Fusion for Multimodal Transformers

Yi Ding, Alex Rich, Mason Wang +4

Multimodal classification is a core task in human-centric machine learning. We observe that information is highly complementary across modalities, thus unimodal information can be…