50 citations · 222 across the 13 of their papers we have counts for
4 papers · 1 filter
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers
Ari S. Morcos, Haonan Yu, Michela Paganini +1
The success of lottery ticket initializations (Frankle and Carbin, 2019) suggests that small, sparsified networks can be trained so long as the network is initialized appropriately…
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP
Haonan Yu, Sergey Edunov, Yuandong Tian +1
The lottery ticket hypothesis proposes that over-parameterization of deep neural networks (DNNs) aids training by increasing the probability of a "lucky" sub-network initialization…
Insights on representational similarity in neural networks with canonical correlation
Ari S. Morcos, Maithra Raghu, Samy Bengio
Comparing different neural network representations and determining how representations evolve over time remain challenging open questions in our understanding of the function of ne…
On the importance of single directions for generalization
Ari S. Morcos, David G. T. Barrett, Neil C. Rabinowitz +1
Despite their ability to memorize large datasets, deep neural networks often achieve good generalization performance. However, the differences between the learned solutions of netw…