Voting with the Graph: Stable RLAIF via Topological Consistency Maximization

Boyin Liu, Zhuo Zhang, Sen Huang +8

Reinforcement Learning from AI Feedback (RLAIF) relies on LLM judges as preference measurement instruments, yet these instruments are fundamentally limited by random measurement er…