Fairness or Fluency? An Investigation into Language Bias of Pairwise LLM-as-a-Judge

Xiaolin Zhou, Zheng Luo, Yicheng Gao +4

Recent advances in Large Language Models (LLMs) have incentivized the development of LLM-as-a-judge, an application of LLMs where they are used as judges to decide the quality of a…