On the Surrogate Gap between Contrastive and Supervised Losses

Han Bao, Yoshihiro Nagano, Kento Nozawa

Contrastive representation learning encourages data representation to make semantically similar pairs closer than randomly drawn negative samples, which has been successful in vari…