1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.CV2025
Distilling Balanced Knowledge from a Biased Teacher
Seonghak Kim
Conventional knowledge distillation, designed for model compression, fails on long-tailed distributions because the teacher model tends to be biased toward head classes and provide…
cs.CV2025★ 1 cited
FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer
Seonghak Kim
Knowledge distillation (KD) is a widely adopted technique for transferring knowledge from a high-capacity teacher model to a smaller student model by aligning their output distribu…