DYAD: A Descriptive Yet Abjuring Density efficient approximation to linear neural network layers

Sarin Chandy, Varun Gangal, Yi Yang +1

We devise, implement and performance-asses DYAD, a layer which can serve as a faster and more memory-efficient approximate replacement for linear layers, (nn.Linear() in Pytorch).…