Teacher-Guided One-Shot Pruning via Context-Aware Knowledge Distillation

Md. Samiul Alim, Sharjil Khan, Amrijit Biswas +3

Unstructured pruning remains a powerful strategy for compressing deep neural networks, yet it often demands iterative train-prune-retrain cycles, resulting in significant computati…