Investigating Social Bias Changes in Quantized Language Models

Stanley Z. Hua, Sanae Lotfi, Irene Y. Chen

Post-training quantization reduces the memory needed to run large language models but alters their social biases in ways that aggregate metrics fail to capture. We present the firs…