BACON: Budgeted Human Calibration for Modeling and Evaluation with Multiple AI Judges

Lei Shi, Anlan Zhang, Rita Lyu +6

AI judges offer a scalable, low-cost alternative to human evaluation, but their outputs can be biased relative to human preferences and highly item-dependent, varying across judges…