Towards noise contrastive estimation with soft targets for conditional models

Johannes Hugger, Virginie Uhlmann

Soft targets combined with the cross-entropy loss have shown to improve generalization performance of deep neural networks on supervised classification tasks. The standard cross-en…