Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation

Yu-Du Feng, Niels Mündler-Sasahara, Mark Vero +1

Reasoning language models (RLMs) demonstrate impressive performance by leveraging test-time compute in the form of reasoning tokens. However, this behavior makes adapting RLMs to n…