Beyond Binary Labels: Diagnostic Evaluation of LLM Safety with Prompt-Level Rubrics

Hongyu Li, Xinlong Huang, Zhan Yu +13

Current LLM safety benchmarks predominantly rely on binary safe or unsafe labels, lacking explanatory depth and suffering from low consistency across automated judges. To address t…