When Compression Helps and When It Hurts: Condition-Aware Analysis of Chain-of-Thought Distillation

Siyang Lyu, Xinghao Chen, Zhijing Sun +3

Chain-of-Thought (CoT) distillation transfers multi-step reasoning from large reasoning models to smaller students, but verbose teacher traces inflate both training and inference c…