2.3k citations · 2.9k across the 6 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.CV2019
Fast Sparse ConvNets
Erich Elsen, Marat Dukhan, Trevor Gale +1
Historically, the pursuit of efficient inference has been one of the driving forces behind research into new deep learning architectures and building blocks. Some recent examples i…
cs.LG2019★ 118 cited
Rigging the Lottery: Making All Tickets Winners
Utku Evci, Trevor Gale, Jacob Menick +2
Many applications require sparse neural networks due to space or inference time restrictions. There is a large body of work on training dense networks to yield sparse networks for…
cs.LG2019★ 439 cited
The State of Sparsity in Deep Neural Networks
Trevor Gale, Erich Elsen, Sara Hooker
We rigorously evaluate three state-of-the-art techniques for inducing sparsity in deep neural networks on two large-scale learning tasks: Transformer trained on WMT 2014 English-to…