23 citations · 23 across the 2 of their papers we have counts for
2 papers
cs.CL2023
PersonaPKT: Building Personalized Dialogue Agents via Parameter-efficient Knowledge Transfer
Xu Han, Bin Guo, Yoon Jung +4
Personalized dialogue agents (DAs) powered by large pre-trained language models (PLMs) often rely on explicit persona descriptions to maintain personality consistency. However, suc…
cs.CL2019★ 23 cited
Knowledge Distillation from Internal Representations
Gustavo Aguilar, Yuan Ling, Yu Zhang +3
Knowledge distillation is typically conducted by training a small model (the student) to mimic a large and cumbersome model (the teacher). The idea is to compress the knowledge fro…