Distilling Empathy from Large Language Models

Henry J. Xie, Jinghan Zhang, Xinhao Zhang +1

The distillation of knowledge from Large Language Models (LLMs) into Smaller Language Models (SLMs), preserving the capabilities and performance of LLMs while reducing model size,…