119 citations · 217 across the 35 of their papers we have counts for
3 papers · 1 filter
TCNCA: Temporal Convolution Network with Chunked Attention for Scalable Sequence Processing
Aleksandar Terzic, Michael Hersche, Geethan Karunaratne +3
MEGA is a recent transformer-based architecture, which utilizes a linear recurrent operator whose parallel computation, based on the FFT, scales as , with being the s…
MIMONets: Multiple-Input-Multiple-Output Neural Networks Exploiting Computation in Superposition
Nicolas Menet, Michael Hersche, Geethan Karunaratne +3
With the advent of deep learning, progressively larger neural networks have been designed to solve complex tasks. We take advantage of these capacity-rich models to lower the cost…
Factorizers for Distributed Sparse Block Codes
Michael Hersche, Aleksandar Terzic, Geethan Karunaratne +6
Distributed sparse block codes (SBCs) exhibit compact representations for encoding and manipulating symbolic data structures using fixed-width vectors. One major challenge however…