PolyLUT: Ultra-low Latency Polynomial Inference with Hardware-Aware Structured Pruning

Marta Andronic, Jiawen Li, George A. Constantinides

Standard deep neural network inference involves the computation of interleaved linear maps and nonlinear activation functions. Prior work for ultra-low latency implementations has…