Money on the Table: Statistical information ignored by Softmax can improve classifier accuracy

Charles B. Delahunt, Courosh Mehanian, J. Nathan Kutz

Softmax is a standard final layer used in Neural Nets (NNs) to summarize information encoded in the trained NN and return a prediction. However, Softmax leverages only a subset of…