16 citations · 17 across the 12 of their papers we have counts for
1 paper · 1 filter
Kanghui Tian, Siyuan Liu, Tianxiang Jiang +8
More privileged information does not always make a better teacher. We study this tension in on-policy self-distillation (OPSD), where a self-teacher scores the student's own rollou…