1 paper
Youxu Shi, Yifan Sun, Dacheng Yin +5
Off-policy and on-policy distillation have traditionally been formulated as separate paradigms, each favoring a different property of distillation trajectories. Teacher-generated (…