14.1k citations · 23.9k across the 29 of their papers we have counts for
3 papers · 2 filters
Distilling a Neural Network Into a Soft Decision Tree
Nicholas Frosst, Geoffrey Hinton
Deep neural networks have proved to be a very effective way to perform classification tasks. They excel when the input data is high dimensional, the relationship between the input…
Who Said What: Modeling Individual Labelers Improves Classification
Melody Y. Guan, Varun Gulshan, Andrew M. Dai +1
Data are often labeled by many different experts with each expert only labeling a small fraction of the data and each data point being labeled by several experts. This reduces the…
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz +4
The capacity of a neural network to absorb information is limited by its number of parameters. Conditional computation, where parts of the network are active on a per-example basis…