127 citations · 276 across the 11 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018★ 127 cited
The Singular Values of Convolutional Layers
Hanie Sedghi, Vineet Gupta, Philip M. Long
We characterize the singular values of the linear transformation associated with a standard 2D multi-channel convolutional layer, enabling their efficient computation. This charact…
cs.LG2018★ 52 cited
Shampoo: Preconditioned Stochastic Tensor Optimization
Vineet Gupta, Tomer Koren, Yoram Singer
Preconditioned gradient methods are among the most general and powerful tools in optimization. However, preconditioning requires storing and manipulating prohibitively large matric…