Revisiting Pretraining for Semi-Supervised Learning in the Low-Label Regime

Xun Xu, Jingyi Liao, Lile Cai +5

Semi-supervised learning (SSL) addresses the lack of labeled data by exploiting large unlabeled data through pseudolabeling. However, in the extremely low-label regime, pseudo labe…