Conditional Accuracy Profiles: Diagnosing LLM Judges across Deployment Conditions

Wenqi Li, Bin Liu, Mindi Ruan +3

LLM-as-judge is now a standard tool for scalable evaluation, but judge performance is still often summarized by a single accuracy number. This aggregate view hides the deployment c…