Softmax Bias Correction for Quantized Generative Models

Nilesh Prasad Pandey, Marios Fournarakis, Chirag Patel +1

Post-training quantization (PTQ) is the go-to compression technique for large generative models, such as stable diffusion or large language models. PTQ methods commonly keep the so…