A Statistical Framework for Alignment with Biased AI Feedback

Xintao Xia, Zhiqiu Xia, Linjun Zhang +1

Modern alignment pipelines are increasingly replacing expensive human preference labels with evaluations from large language models (LLM-as-Judge). However, AI labels can be system…