5 citations · 8 across the 6 of their papers we have counts for
4 papers · 1 filter
K2P: Label-Free Knowledge to Prompt Distillation
Yingchuan Zhang, Haoran Lu, Wenxuan Zhong +1
Knowledge distillation can transfer reasoning from stronger teachers to frozen students through reusable prompts, but avoiding weight updates does not eliminate supervision. Withou…
A Statistical Perspective on Knowledge Distillation: Foundations, Classical Methods, and Large Language Model Extensions
Luyang Fang, Haoran Lu, Jiazhang Cai +4
Knowledge Distillation (KD) has emerged as a vital paradigm for transferring the capabilities of high-capacity models to efficient ``student'' counterparts, addressing critical cha…
Complex Problem Solving in Large Language Models: A Statistical Control Survey and Diagnostic Framework
Jiazhang Cai, Tao Wang, Ruidong Zhang +35
Complex problem solving (CPS) with large language models (LLMs) is often framed as a matter of stronger reasoning or longer generation. Yet early-step error amplification, prompt b…
Knowledge Cascade: Reverse Knowledge Distillation on Nonparametric Multivariate Functional Estimation
Luyang Fang, Haoran Lu, Yongkai Chen +2
As machine learning models and datasets continue to grow, developing complex models has become increasingly computationally demanding. Knowledge distillation reduces deployment cos…