An Empirical Study of Knowledge Distillation for Code Understanding Tasks

Ruiqi Wang, Zezhou Yang, Cuiyun Gao +2

Pre-trained language models (PLMs) have emerged as powerful tools for code understanding. However, deploying these PLMs in large-scale applications faces practical challenges due t…