3 papers
cs.CV2025
Heterogeneous Complementary Distillation
Liuchi Xu, Hao Zheng, Lu Wang +2
Knowledge distillation (KD)transfers the dark knowledge from a complex teacher to a compact student. However, heterogeneous architecture distillation, such as Vision Transformer (V…
cs.CV2025
Local Dense Logit Relations for Enhanced Knowledge Distillation
Liuchi Xu, Kang Liu, Jinshuai Liu +3
State-of-the-art logit distillation methods exhibit versatility, simplicity, and efficiency. Despite the advances, existing studies have yet to delve thoroughly into fine-grained r…
cs.CV2023
Latent Degradation Representation Constraint for Single Image Deraining
Yuhong He, Long Peng, Lu Wang +1
Since rain streaks show a variety of shapes and directions, learning the degradation representation is extremely challenging for single image deraining. Existing methods are mainly…