Bayesian Calibration of Win Rate Estimation with LLM Evaluators

Yicheng Gao, Gonghan Xu, Zhe Wang +1

Recent advances in large language models (LLMs) show the potential of using LLMs as evaluators for assessing the quality of text generations from LLMs. However, applying LLM evalua…