ReNIO: Reweighting Negative Trajectory Importance for LLM On-Policy Distillation

Chen Lin, Kedi Chen, Wei Zhang

On-policy distillation (OPD) improves LLM reasoning by training a student model on its own generated outputs, but standard OPD treats all student-generated outputs (SGOs) equally r…