Condition-Contrastive Extrapolation for On-Policy Distillation of Language Models

Wenxuan Luo, Chenxi Li, Haoyue Liu +2

On-policy distillation (OPD) improves a student language model by training on its own generated trajectories with supervision from a stronger teacher. However, when conditioned on…