Mixtraining: A Better Trade-Off Between Compute and Performance

Zexin Li, Jiancheng Zhang, Yufei Li +2

Incorporating self-supervised learning (SSL) before standard supervised learning (SL) has become a widely used strategy to enhance model performance, particularly in data-limited s…