Look-ups are not (yet) all you need for deep learning inference

Calvin McCarter, Nicholas Dronen

Fast approximations to matrix multiplication have the potential to dramatically reduce the cost of neural network inference. Recent work on approximate matrix multiplication propos…