Evolving Knowledge Distillation with Large Language Models and Active Learning

Chengyuan Liu, Yangyang Kang, Fubang Zhao +4

Large language models (LLMs) have demonstrated remarkable capabilities across various NLP tasks. However, their computational costs are prohibitively high. To address this issue, p…