Training Specialist Models without Reasoning Trajectories for Domain Expert Distillation

Yilei Tu, Zihao Li, Shaoxiong Ji +2

Specialist distillation effectively transfers domain expertise to student models via teacher-generated reasoning trajectories. However, when these specialists are trained solely on…