Effectiveness of Hierarchical Softmax in Large Scale Classification Tasks

Abdul Arfat Mohammed, Venkatesh Umaashankar

Typically, Softmax is used in the final layer of a neural network to get a probability distribution for output classes. But the main problem with Softmax is that it is computationa…