2.1k citations · 6.1k across the 19 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.LG2017★ 222 cited
Device Placement Optimization with Reinforcement Learning
Azalia Mirhoseini, Hieu Pham, Quoc V. Le +7
The past few years have witnessed a growth in size and computational requirements for training and inference with neural networks. Currently, a common approach to address these req…
cs.LG2017★ 267 cited
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz +4
The capacity of a neural network to absorb information is limited by its number of parameters. Conditional computation, where parts of the network are active on a per-example basis…