Aligning Multimodal Representations through an Information Bottleneck

Antonio Almudévar, José Miguel Hernández-Lobato, Sameer Khurana +2

Contrastive losses have been extensively used as a tool for multimodal representation learning. However, it has been empirically observed that their use is not effective to learn a…