Cross Entropy in Deep Learning of Classifiers Is Unnecessary -- ISBE Error is All You Need

Wladyslaw Skarbek

In deep learning classifiers, the cost function usually takes the form of a combination of SoftMax and CrossEntropy functions. The SoftMax unit transforms the scores predicted by t…