4 citations · 12 across the 9 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CL2023★ 2 cited
MCC-KD: Multi-CoT Consistent Knowledge Distillation
Hongzhan Chen, Siyue Wu, Xiaojun Quan +3
Large language models (LLMs) have showcased remarkable capabilities in complex reasoning through chain of thought (CoT) prompting. Recently, there has been a growing interest in tr…
cs.CL2023★ 2 cited
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression
Siyue Wu, Hongzhan Chen, Xiaojun Quan +2
Knowledge distillation has attracted a great deal of interest recently to compress pre-trained language models. However, existing knowledge distillation methods suffer from two lim…