Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale

Flavio Di Palo, Prateek Singhi, Bilal Fadlallah

Large Language Models (LLMs) face significant challenges at inference time due to their high computational demands. To address this, we present Performance-Guided Knowledge Distill…