Vertical Layering of Quantized Neural Networks for Heterogeneous Inference

Hai Wu, Ruifei He, Haoru Tan +2

Although considerable progress has been obtained in neural network quantization for efficient inference, existing methods are not scalable to heterogeneous devices as one dedicated…