Cross-Architectural Positive Pairs improve the effectiveness of Self-Supervised Learning

Pranav Singh, Jacopo Cirrone

Existing self-supervised techniques have extreme computational requirements and suffer a substantial drop in performance with a reduction in batch size or pretraining epochs. This…