1 paper · 1 filter
Dongxu Zhang, Zhichao Yang, Sepehr Janghorbani +6
On-policy distillation (OPD), which samples trajectories from the student model and supervises them with a teacher at the token level, avoids relying solely on verifiable terminal…