Improving Unimodal Inference with Multimodal Transformers

Kateryna Chumachenko, Alexandros Iosifidis, Moncef Gabbouj

This paper proposes an approach for improving performance of unimodal models with multimodal training. Our approach involves a multi-branch architecture that incorporates unimodal…