Grade Score: Quantifying LLM Performance in Option Selection

Dmitri Iourovitski

This study introduces the "Grade Score", a novel metric designed to evaluate the consistency and fairness of Large Language Models (LLMs) when used as multiple-choice judges with r…