2 papers
cs.CV2025
Expandable Residual Approximation for Knowledge Distillation
Zhaoyi Yan, Binghui Chen, Yunfan Liu +1
Knowledge distillation (KD) aims to transfer knowledge from a large-scale teacher model to a lightweight one, significantly reducing computational and storage requirements. However…
cs.CV2025
Delving Deep into Semantic Relation Distillation
Zhaoyi Yan, Kangjun Liu, Qixiang Ye
Knowledge distillation has become a cornerstone technique in deep learning, facilitating the transfer of knowledge from complex models to lightweight counterparts. Traditional dist…