Embedding Geometries of Contrastive Language-Image Pre-Training

Jason Chuan-Chih Chou, Nahid Alam

Since the publication of CLIP, the approach of using InfoNCE loss for contrastive pre-training has become widely popular for bridging two or more modalities. Despite its wide adopt…