1 citations · 1 across the 3 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.CV2025
Heterogeneous Complementary Distillation
Liuchi Xu, Hao Zheng, Lu Wang +2
Knowledge distillation (KD)transfers the dark knowledge from a complex teacher to a compact student. However, heterogeneous architecture distillation, such as Vision Transformer (V…
cs.CV2025
Local Dense Logit Relations for Enhanced Knowledge Distillation
Liuchi Xu, Kang Liu, Jinshuai Liu +3
State-of-the-art logit distillation methods exhibit versatility, simplicity, and efficiency. Despite the advances, existing studies have yet to delve thoroughly into fine-grained r…