801 citations · 1.1k across the 20 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2021
Spectral Tensor Train Parameterization of Deep Learning Layers
Anton Obukhov, Maxim Rakhuba, Alexander Liniger +4
We study low-rank parameterizations of weight matrices with embedded spectral properties in the Deep Learning context. The low-rank property leads to parameter efficiency and permi…
cs.LG2020★ 14 cited
T-Basis: a Compact Representation for Neural Networks
Anton Obukhov, Maxim Rakhuba, Stamatios Georgoulis +3
We introduce T-Basis, a novel concept for a compact representation of a set of tensors, each of an arbitrary shape, which is often seen in Neural Networks. Each of the tensors in t…