Equally Critical: Samples, Targets, and Their Mappings in Datasets

Runkang Yang, Peng Sun, Xinyi Shang +2

Data inherently possesses dual attributes: samples and targets. For targets, knowledge distillation has been widely employed to accelerate model convergence, primarily relying on t…