A Mathematical Perspective On Contrastive Learning

Ricardo Baptista, Andrew M. Stuart, Son Tran

Multimodal contrastive learning is a methodology for linking different data modalities; the canonical example is linking image and text data. The methodology is typically framed as…