Adaptive Sparse Softmax: An Effective and Efficient Softmax Variant

Qi Lv, Lei Geng, Ziqiang Cao +4

Softmax with the cross entropy loss is the standard configuration for current neural classification models. The gold score for a target class is supposed to be 1, but it is never r…