CADENCE: Closing the Reasoning Gap via Coverage-Adaptive On-Policy Distillation

Satyam Kumar, Saurabh Jha

On-policy knowledge distillation transfers reasoning from large teachers to compact students, but existing approaches suffer three compounding failure modes: (i) cold-start collaps…