Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks

Tianqing Zhang, Zixin Zhu, Kairong Yu +1

Spiking Neural Networks (SNNs) have emerged as a promising approach for energy-efficient and biologically plausible computation. However, due to limitations in existing training me…