Analyzing and Improving Representations with the Soft Nearest Neighbor Loss

Nicholas Frosst, Nicolas Papernot, Geoffrey Hinton

We explore and expand the $\text{Soft Nearest Neighbor Loss}$ to measure the $\text{entanglement}$ of class manifolds in representation space: i.e., how close pairs of points f…