Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Knowledge Distillation Must Account for What It Loses
Wenshuo Wang
This position paper argues that knowledge distillation must account for what it loses: student models should be judged not only by retained task scores, but by whether they preserv…
cs.LG2025
S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting
Wenshuo Wang, Yaomin Shen, Yingjie Tan +1
Spatiotemporal forecasting often relies on computationally intensive models to capture complex dynamics. Knowledge distillation (KD) has emerged as a key technique for creating lig…