Dynamically Scaled Temperature in Self-Supervised Contrastive Learning

Siladittya Manna, Soumitri Chattopadhyay, Rakesh Dey +2

In contemporary self-supervised contrastive algorithms like SimCLR, MoCo, etc., the task of balancing attraction between two semantically similar samples and repulsion between two…