Audit Before You Distill: A Controlled Workflow for Reasoning Transfer into Compact Medical Language Models

Tiago Martinelli, João Paulo Papa, Adriano José Pereira

Teacher rationales can help a smaller model answer health professions questions, but they can also reinforce errors. We examined when they help and how this evidence can guide trai…