Augmenting Hessians with Inter-Layer Dependencies for Mixed-Precision Post-Training Quantization

Clemens JS Schaefer, Navid Lambert-Shirzad, Xiaofan Zhang +7

Efficiently serving neural network models with low latency is becoming more challenging due to increasing model complexity and parameter count. Model quantization offers a solution…