599 citations · 965 across the 6 of their papers we have counts for
3 papers · 1 filter
Exact gradient updates in time independent of output size for the spherical loss family
Pascal Vincent, Alexandre de Brébisson, Xavier Bouthillier
An important class of problems involves training deep neural networks with sparse prediction targets of very high dimension D. These occur naturally in e.g. neural language models…
The Z-loss: a shift and scale invariant classification loss belonging to the Spherical Family
Alexandre de Brébisson, Pascal Vincent
Despite being the standard loss function to train multi-class neural networks, the log-softmax has two potential limitations. First, it involves computations that scale linearly wi…
Theano: A Python framework for fast computation of mathematical expressions
The Theano Development Team, Rami Al-Rfou, Guillaume Alain +110
Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has bee…