Metric Match: A Subset Selection Approach to Evaluating LLM Judge Reliability

Alyssa Unell, Natalie Dullerud, Naomi Boneh +4

LLM judges are used to reduce the need for costly human labor in evaluating open-ended text generation. However, the reliability of these judges depends critically on their alignme…