Establishing a stronger baseline for lightweight contrastive models

Wenye Lin, Yifeng Ding, Zhixiong Cao +1

Recent research has reported a performance degradation in self-supervised contrastive learning for specially designed efficient networks, such as MobileNet and EfficientNet. A comm…