BD-KD: Balancing the Divergences for Online Knowledge Distillation

Ibtihel Amara, Nazanin Sepahvand, Brett H. Meyer +2

We address the challenge of producing trustworthy and accurate compact models for edge devices. While Knowledge Distillation (KD) has improved model compression in terms of achievi…