555 citations · 1.7k across the 35 of their papers we have counts for
Showing cs.NEShow all
2 papers · 1 filter
cs.NE2016★ 1 cited
Exact gradient updates in time independent of output size for the spherical loss family
Pascal Vincent, Alexandre de Brébisson, Xavier Bouthillier
An important class of problems involves training deep neural networks with sparse prediction targets of very high dimension D. These occur naturally in e.g. neural language models…
cs.NE2015★ 67 cited
An Exploration of Softmax Alternatives Belonging to the Spherical Loss Family
Alexandre de Brébisson, Pascal Vincent
In a multi-class classification problem, it is standard to model the output of a neural network as a categorical distribution conditioned on the inputs. The output must therefore b…