Breaking the Softmax Bottleneck for Sequential Recommender Systems with Dropout and Decoupling

Ying-Chen Lin

The Softmax bottleneck was first identified in language modeling as a theoretical limit on the expressivity of Softmax-based models. Being one of the most widely-used methods to ou…