Mixed Precision Post Training Quantization of Neural Networks with Sensitivity Guided Search

Clemens JS Schaefer, Elfie Guo, Caitlin Stanton +7

Serving large-scale machine learning (ML) models efficiently and with low latency has become challenging owing to increasing model size and complexity. Quantizing models can simult…