The Refusal--Compliance Tradeoff: A Large-Scale Safety Behavior Audit of Large Language Models

Alif Al Hasan, Sumon Biswas

Refusal rates are a poor proxy for LLM safety, i.e., a model may over-refuse benign prompts while still complying with harmful ones. We audit both failure modes across 21 open-weig…