Distilling Reasoning Ability from Large Language Models with Adaptive Thinking

Xiaoshu Chen, Sihang Zhou, Ke Liang +1

Chain of thought finetuning (cot-finetuning) aims to endow small language models (SLM) with reasoning ability to improve their performance towards specific tasks by allowing them t…