Analysis of Using Sigmoid Loss for Contrastive Learning

Chungpa Lee, Joonhwan Chang, Jy-yong Sohn

Contrastive learning has emerged as a prominent branch of self-supervised learning for several years. Especially, CLIP, which applies contrastive learning to large sets of captione…