Incomplete Dot Products for Dynamic Computation Scaling in Neural Network Inference

Bradley McDanel, Surat Teerapittayanon, H. T. Kung

We propose the use of incomplete dot products (IDP) to dynamically adjust the number of input channels used in each layer of a convolutional neural network during feedforward infer…