Mentor-KD: Making Small Language Models Better Multi-step Reasoners

Hojae Lee, Junho Kim, SangKeun Lee

Large Language Models (LLMs) have displayed remarkable performances across various complex tasks by leveraging Chain-of-Thought (CoT) prompting. Recently, studies have proposed a K…