Noise as a Resource for Learning in Knowledge Distillation

Elahe Arani, Fahad Sarfraz, Bahram Zonooz

While noise is commonly considered a nuisance in computing systems, a number of studies in neuroscience have shown several benefits of noise in the nervous system from enabling the…