Mutual Enhancement of Large and Small Language Models with Cross-Silo Knowledge Transfer

Yongheng Deng, Ziqing Qiao, Ju Ren +2

While large language models (LLMs) are empowered with broad knowledge, their task-specific performance is often suboptimal. It necessitates fine-tuning LLMs with task-specific data…