Self-organized Hierarchical Softmax

Yikang Shen, Shawn Tan, Chrisopher Pal +1

We propose a new self-organizing hierarchical softmax formulation for neural-network-based language models over large vocabularies. Instead of using a predefined hierarchical struc…