Self Distillation via Iterative Constructive Perturbations

Maheak Dave, Aniket Kumar Singh, Aryan Pareek +3

Deep Neural Networks have achieved remarkable achievements across various domains, however balancing performance and generalization still remains a challenge while training these n…