most citedGKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CL2023★ 1 cited

GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model

Shicheng Tan, Weng Lam Tam, Yuanchun Wang +9

Currently, the reduction in the parameter scale of large-scale pre-trained language models (PLMs) through knowledge distillation has greatly facilitated their widespread deployment…