Better Answers, Weaker Evidence Control: Evidence Bypass in On-Policy Distillation

Ruoran Xu, Yilun Zhao, Ziyu Chen +2

On-policy distillation (OPD) can improve answer accuracy while weakening responsiveness to supporting evidence. We investigate this separation in scientific-document question answe…