2 papers
cs.LG2026
Progressive: A Teacher-Student Progressive Co-Evolving Knowledge Distillation Method for Substantial Model Compression
Tiancong Cheng, Ying Zhang, Zhiwen Yu +2
Knowledge distillation (KD) is a widely utilized technique for transferring knowledge from a large model (the teacher) to a smaller model (the student). Owing to its flexibility an…
cs.LG2025
JointDistill: Adaptive Multi-Task Distillation for Joint Depth Estimation and Scene Segmentation
Tiancong Cheng, Ying Zhang, Yuxuan Liang +3
Depth estimation and scene segmentation are two important tasks in intelligent transportation systems. A joint modeling of these two tasks will reduce the requirement for both the…