Showing stat.APShow all
2 papers · 1 filter
stat.AP2026
BayesJudge: Uncertainty-Aware Bayesian Meta-Evaluation of Human and LLM Judgments
Jiahao Zhang, Pengbin Feng, Chunlei Meng +2
AI evaluation pipelines often produce conflicting judgments rather than clean labels. In pairwise LLM evaluation, this conflict is especially visible: disagreement can arise from a…
stat.AP2026
Second-Order Response Laws for LLM Judges: Debiased Estimation of Prompt Instability
Pengbin Feng, Chunlei Meng, Daozheng Qu +3
LLM judges are often evaluated with a single prompt and only a few repeated calls. When their verdicts vary, it remains unclear whether the variation comes from sampling noise with…