42 citations · 319 across the 36 of their papers we have counts for
Showing 2020 · cs.LGShow all
2 papers · 2 filters
cs.LG2020
A case where a spindly two-layer linear network whips any neural network with a fully connected input layer
Manfred K. Warmuth, Wojciech Kotłowski, Ehsan Amid
It was conjectured that any neural network of any structure and arbitrary differentiable transfer functions at the nodes cannot learn the following problem sample efficiently when…
cs.LG2020★ 2 cited
Reparameterizing Mirror Descent as Gradient Descent
Ehsan Amid, Manfred K. Warmuth
Most of the recent successful applications of neural networks have been based on training with gradient descent updates. However, for some small networks, other mirror descent upda…