29 citations · 91 across the 43 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.LG2020★ 6 cited
Implicit Regularization in ReLU Networks with the Square Loss
Gal Vardi, Ohad Shamir
Understanding the implicit regularization (or implicit bias) of gradient descent has recently been a very active research area. However, the implicit regularization in nonlinear ne…
cs.LG2020★ 7 cited
Hardness of Learning Neural Networks with Natural Weights
Amit Daniely, Gal Vardi
Neural networks are nowadays highly successful despite strong hardness results. The existing hardness results focus on the network architecture, and assume that the network's weigh…
cs.LG2020★ 5 cited
Neural Networks with Small Weights and Depth-Separation Barriers
Gal Vardi, Ohad Shamir
In studying the expressiveness of neural networks, an important question is whether there are functions which can only be approximated by sufficiently deep networks, assuming their…