Showing cs.CVShow all
2 papers · 1 filter
cs.CV2026★ 1 cited
FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer
Seonghak Kim
Knowledge distillation (KD) is a widely adopted technique for transferring knowledge from a high-capacity teacher model to a smaller student model by aligning their output distribu…
cs.CV2026
Distilling Balanced Knowledge from a Biased Teacher
Seonghak Kim
Conventional knowledge distillation, designed for model compression, fails on long-tailed distributions because the teacher model tends to be biased toward head classes and provide…