APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

Elan Rosenfeld, Preetum Nakkiran, Hadi Pouransari +2

Recent advances in learning aligned multimodal representations have been primarily driven by training large neural networks on massive, noisy paired-modality datasets. In this work…