Importance Analysis for Dynamic Control of Balancing Parameter in a Simple Knowledge Distillation Setting

Seongmin Kim, Kwanho Kim, Minseung Kim +1

Although deep learning models owe their remarkable success to deep and complex architectures, this very complexity typically comes at the expense of real-time performance. To addre…