2 papers
cs.LG2020
Subclass Distillation
Rafael Müller, Simon Kornblith, Geoffrey Hinton
After a large "teacher" neural network has been trained on labeled data, the probabilities that the teacher assigns to incorrect classes reveal a lot of information about the way i…
cs.LG2019
When Does Label Smoothing Help?
Rafael Müller, Simon Kornblith, Geoffrey Hinton
The generalization and learning speed of a multi-class neural network can often be significantly improved by using soft targets that are a weighted average of the hard targets and…