Scaling Laws for Task-Specific LLM Distillation

Lavinia Ghita, Dhruv Desai, Ioana Boier

Large Language Models (LLMs) achieve strong performance across a growing range of domains, yet their scale poses deployment challenges in applications where latency and cost constr…