622 citations · 948 across the 19 of their papers we have counts for
5 papers · 1 filter
Winning the Lottery with Continuous Sparsification
Pedro Savarese, Hugo Silva, Michael Maire
The search for efficient, sparse deep neural network models is most prominently performed by pruning: training a dense, overparameterized network and removing parameters, usually v…
Domain-independent Dominance of Adaptive Methods
Pedro Savarese, David McAllester, Sudarshan Babu +1
From a simplified analysis of adaptive methods, we derive AvaGrad, a new optimizer which outperforms SGD on vision tasks when its adaptability is properly tuned. We observe that th…
ALERT: Accurate Learning for Energy and Timeliness
Chengcheng Wan, Muhammad Santriaji, Eri Rogers +3
An increasing number of software applications incorporate runtime Deep Neural Networks (DNNs) to process sensor data and return inference results to humans. Effective deployment of…
Multigrid Neural Memory
Tri Huynh, Michael Maire, Matthew R. Walter
We introduce a novel approach to endowing neural networks with emergent, long-term, large-scale memory. Distinct from strategies that connect neural networks to external memory ban…
Learning Implicitly Recurrent CNNs Through Parameter Sharing
Pedro Savarese, Michael Maire
We introduce a parameter sharing scheme, in which different layers of a convolutional neural network (CNN) are defined by a learned linear combination of parameter tensors from a g…