Unifying Synergies between Self-supervised Learning and Dynamic Computation

Tarun Krishna, Ayush K Rai, Alexandru Drimbarean +5

Computationally expensive training strategies make self-supervised learning (SSL) impractical for resource constrained industrial settings. Techniques like knowledge distillation (…