Compressing 1D Time-Channel Separable Convolutions using Sparse Random Ternary Matrices

Gonçalo Mordido, Matthijs Van Keirsbilck, Alexander Keller

We demonstrate that 1x1-convolutions in 1D time-channel separable convolutions may be replaced by constant, sparse random ternary matrices with weights in $\{-1,0,+1\}$. Such layer…