EKLAV: Elicited Key CoT Learning via Answer only superVision

Adarsh Singh, Aman Singh, Kushal Raj Bhandari +4

Reasoning distillation trains a student to reproduce both the teacher's chain-of-thought trace and its final answer. We ask whether the trace is better used as privileged training…