BARD: budget-aware reasoning distillation

Lujie Niu, Lei Shen, Yi Jiang +4

While long Chain-of-Thought (CoT) distillation effectively transfers reasoning capability to smaller language models, the reasoning process often remains redundant and computationa…