Mitigating Scoring Bias in LLM-as-a-Judge via Random Number Generation

Yuma Asato, Kiyoaki Shirai, Natthawut Kertkeidkachorn

Large Language Models (LLMs) are often used as evaluators of text quality, known as LLM-as-a-Judge, which can outperform conventional automatic evaluation metrics that rely on refe…