2 papers
cs.LG2026
Generalized Kullback-Leibler Divergence Loss
Jiequan Cui, Beier Zhu, Qingshan Xu +5
In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence loss and mathematically prove that it is equivalent to the Decoupled Kullback-Leibler (DKL) Divergence loss…
cs.LG2025
Generative Distribution Distillation
Jiequan Cui, Beier Zhu, Qingshan Xu +6
In this paper, we formulate the knowledge distillation (KD) as a conditional generative problem and propose the \textit{Generative Distribution Distillation (GenDD)} framework. A n…