72 citations · 75 across the 3 of their papers we have counts for
3 papers
On the Optimal Memorization Power of ReLU Neural Networks
Gal Vardi, Gilad Yehudai, Ohad Shamir
We study the memorization power of feedforward ReLU neural networks. We show that such networks can memorize any points that satisfy a mild separability assumption using $\tild…
The Connection Between Approximation, Depth Separation and Learnability in Neural Networks
Eran Malach, Gilad Yehudai, Shai Shalev-Shwartz +1
Several recent works have shown separation results between deep neural networks, and hypothesis classes with inferior approximation capacity such as shallow networks or kernel clas…
Proving the Lottery Ticket Hypothesis: Pruning is All You Need
Eran Malach, Gilad Yehudai, Shai Shalev-Shwartz +1
The lottery ticket hypothesis (Frankle and Carbin, 2018), states that a randomly-initialized network contains a small subnetwork such that, when trained in isolation, can compete w…