On The Distribution of Penultimate Activations of Classification Networks

Minkyo Seo, Yoonho Lee, Suha Kwak

This paper studies probability distributions of penultimate activations of classification networks. We show that, when a classification network is trained with the cross-entropy lo…