DuoOPD: Learning from Joint Teacher-Student Outcomes for Multi-Task On-Policy Distillation

Ao Yu, Weibo Gao, Heng Zhou +6

On-policy distillation (OPD) trains a student on its own responses with token-level feedback from a stronger teacher, yet the teacher can fail on questions the student already answ…