4 citations · 4 across the 4 of their papers we have counts for
4 papers
Powerful Teachers Matter: Text-Guided Multi-view Knowledge Distillation with Visual Prior Enhancement
Xin Zhang, Jianyang Xu, Hao Peng +5
Knowledge distillation transfers knowledge from large teacher models to smaller students for efficient inference. While existing methods primarily focus on distillation strategies,…
From Beginner to Expert: Modeling Medical Knowledge into General LLMs
Qiang Li, Xiaoyan Yang, Haowen Wang +14
Recently, large language model (LLM) based artificial intelligence (AI) systems have demonstrated remarkable capabilities in natural language understanding and generation. However,…
AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation
Junjie Wang, Yicheng Chen, Wangshu Zhang +3
Leveraging knowledge from multiple tasks through introducing a small number of task specific parameters into each transformer layer, also known as adapters, receives much attention…
Reverse Chain: A Generic-Rule for LLMs to Master Multi-API Planning
Yinger Zhang, Hui Cai, Xeirui Song +3
While enabling large language models to implement function calling (known as APIs) can greatly enhance the performance of Large Language Models (LLMs), function calling is still a…