DSPNet: Towards Slimmable Pretrained Networks based on Discriminative Self-supervised Learning

Shaoru Wang, Zeming Li, Jin Gao +2

Self-supervised learning (SSL) has achieved promising downstream performance. However, when facing various resource budgets in real-world applications, it costs a huge computation…