Understanding Knowledge Distillation in Post-Training: When It Helps and When It Fails

Xin Liu, Simin Ma, Shujian Liu +5

Large language models (LLMs) achieve strong performance across many tasks, but their high computational cost limits deployment in resource-constrained environments. Knowledge Disti…